Source proxy and Edge docs from GitHub (#3122)
## What
The main purpose of this PR is to
1. Delete the proxy docs in this repo and replace them with the proxy's
GitHub readme.
2. Add the docs for Unleash Edge.
### Detailed change description
This PR contains a lot of small changes in a large number of files. To
make it easier to get an overview, here's a detailed description of what
happens where:
#### In the `website/docs`directory
Except for the deletion of the proxy doc, all changes in this directory
are rewriting internal links, so that they point to the newly generated
document instead.
#### `package.json` and `yarn.lock`
When including the documentation for Edge, we also want to render the
mermaid diagrams it uses. Docusaurus supports this via a plugin. All
changes in these files are related to installing that plugin.
#### `docusaurus.config.js`
There's two types of changes in this file:
1. Mermaid-related changes: we ask docusaurus to render mermaid in
markdown files and add the plugin
2. Document generation. There's some rewrites to the sdk doc generation
plus an entirely new section that generates docs for Edge and the proxy
#### `sidebars.js`
Two things:
1. Add the edge docs
2. Move both the Edge and the proxy docs up a level, so that they're
directly under "reference docs" instead of nested inside "unleash
concepts".
#### In the `website/remote-content` directory
These are the remote content files. Previously, all of this lived only
in a `readme-fns.js` file, but with the introduction of Edge and proxy
docs, this has been moved into its own directory and refactored into
three files (`shared`, `sdks`, `edge-proxy`).
#### `custom.css`
Style updates to center mermaid diagrams and provide more space around
them.
#### In `static/img`
The image files that were included in the proxy doc and that have been
deleted.
## Why
For two reasons:
1. Reduce duplication for the proxy. Have one source of truth.
2. Add docs for edge.
## Discussion points and review wishes
This is a big PR, and I don't expect anyone to do a line-by-line review
of it, nor do I think that is particularly useful. Instead, I'd like to
ask reviewers to:
1. Visit the [documentation
preview](https://unleash-docs-git-docs-source-proxy-gh-unleash-team.vercel.app/reference/unleash-proxy)
and have a look at both the proxy docs and the Edge docs. Potentially
have a look at the SDK docs too to verify that everything still works.
2. Consider whether they think moving the proxy and edge docs up a level
(in the sidebar) makes sense.
3. Let me know what slug they'd prefer for the Edge docs. I've gone with
`unleash-edge` for now (so that it's
`docs.getunleash.io/reference/unleash-edge`), but we could potentially
also just use `edge`. WDYT?
4. Read through the detailed changes section.
5. Let me know if they have any other concerns or questions.
## Screenies
The new proxy doc:
![image](https://user-images.githubusercontent.com/17786332/219043145-1c75c83e-4191-45a3-acb5-775d05d13862.png)
The new edge doc:
![image](https://user-images.githubusercontent.com/17786332/219043220-1f5daf13-972e-4d56-8aaf-70ff1812863e.png)
2023-02-16 13:36:28 +01:00
|
|
|
const path = require('path');
|
|
|
|
|
|
|
|
module.exports.mapObject = (fn) => (o) =>
|
|
|
|
Object.fromEntries(Object.entries(o).map(fn));
|
|
|
|
|
|
|
|
module.exports.enrichAdditional =
|
|
|
|
(additionalProperties) =>
|
|
|
|
([repoName, repoData]) => {
|
|
|
|
const repoUrl = `https://github.com/Unleash/${repoName}`;
|
|
|
|
const slugName = (
|
|
|
|
repoData.slugName ?? repoData.sidebarName
|
|
|
|
).toLowerCase();
|
|
|
|
const branch = repoData.branch ?? 'main';
|
|
|
|
|
|
|
|
return [
|
|
|
|
repoName,
|
|
|
|
{ ...repoData, repoUrl, slugName, branch, ...additionalProperties },
|
|
|
|
];
|
|
|
|
};
|
|
|
|
module.exports.enrich = module.exports.enrichAdditional({});
|
|
|
|
|
|
|
|
module.exports.getRepoData = (documents) => (filename) => {
|
|
|
|
const repoName = filename.split('/')[0];
|
|
|
|
|
|
|
|
const repoData = documents[repoName];
|
|
|
|
|
|
|
|
return { name: repoName, ...repoData };
|
|
|
|
};
|
|
|
|
|
|
|
|
// Replace links in the incoming readme content.
|
|
|
|
//
|
|
|
|
// There's one cases we want to handle:
|
|
|
|
//
|
|
|
|
// 1. Relative links that point to the repo. These must be prefixed with the
|
|
|
|
// link to the github repo.
|
|
|
|
//
|
|
|
|
// Note: You might be tempted to handle absolute links to docs.getunleash.io and
|
|
|
|
// make them relative. While absolute links will work, they trigger full page
|
|
|
|
// refreshes. Relative links give a slightly smoother user experience.
|
|
|
|
//
|
|
|
|
// However, if the old link goes to a redirect, then the client-side redirect
|
|
|
|
// will not kick in, so you'll end up with a "Page not found".
|
|
|
|
const replaceLinks = ({ content, repo }) => {
|
|
|
|
const replace = (processRelativeUrl) => (url) => {
|
|
|
|
try {
|
|
|
|
// This constructor will throw if the URL is relative.
|
|
|
|
// https://developer.mozilla.org/en-US/docs/Web/API/URL/URL
|
|
|
|
new URL(url);
|
|
|
|
|
|
|
|
return url;
|
|
|
|
} catch {
|
|
|
|
const separator = url.startsWith('/') ? '' : '/';
|
|
|
|
return processRelativeUrl(url, separator);
|
|
|
|
}
|
|
|
|
};
|
|
|
|
|
|
|
|
const replaceMarkdownLink = replace((url, separator) => {
|
|
|
|
// case 1
|
|
|
|
if (url.startsWith('#')) {
|
|
|
|
// ignore links to other doc sections
|
2023-11-02 10:45:47 +01:00
|
|
|
return url.toLowerCase();
|
Source proxy and Edge docs from GitHub (#3122)
## What
The main purpose of this PR is to
1. Delete the proxy docs in this repo and replace them with the proxy's
GitHub readme.
2. Add the docs for Unleash Edge.
### Detailed change description
This PR contains a lot of small changes in a large number of files. To
make it easier to get an overview, here's a detailed description of what
happens where:
#### In the `website/docs`directory
Except for the deletion of the proxy doc, all changes in this directory
are rewriting internal links, so that they point to the newly generated
document instead.
#### `package.json` and `yarn.lock`
When including the documentation for Edge, we also want to render the
mermaid diagrams it uses. Docusaurus supports this via a plugin. All
changes in these files are related to installing that plugin.
#### `docusaurus.config.js`
There's two types of changes in this file:
1. Mermaid-related changes: we ask docusaurus to render mermaid in
markdown files and add the plugin
2. Document generation. There's some rewrites to the sdk doc generation
plus an entirely new section that generates docs for Edge and the proxy
#### `sidebars.js`
Two things:
1. Add the edge docs
2. Move both the Edge and the proxy docs up a level, so that they're
directly under "reference docs" instead of nested inside "unleash
concepts".
#### In the `website/remote-content` directory
These are the remote content files. Previously, all of this lived only
in a `readme-fns.js` file, but with the introduction of Edge and proxy
docs, this has been moved into its own directory and refactored into
three files (`shared`, `sdks`, `edge-proxy`).
#### `custom.css`
Style updates to center mermaid diagrams and provide more space around
them.
#### In `static/img`
The image files that were included in the proxy doc and that have been
deleted.
## Why
For two reasons:
1. Reduce duplication for the proxy. Have one source of truth.
2. Add docs for edge.
## Discussion points and review wishes
This is a big PR, and I don't expect anyone to do a line-by-line review
of it, nor do I think that is particularly useful. Instead, I'd like to
ask reviewers to:
1. Visit the [documentation
preview](https://unleash-docs-git-docs-source-proxy-gh-unleash-team.vercel.app/reference/unleash-proxy)
and have a look at both the proxy docs and the Edge docs. Potentially
have a look at the SDK docs too to verify that everything still works.
2. Consider whether they think moving the proxy and edge docs up a level
(in the sidebar) makes sense.
3. Let me know what slug they'd prefer for the Edge docs. I've gone with
`unleash-edge` for now (so that it's
`docs.getunleash.io/reference/unleash-edge`), but we could potentially
also just use `edge`. WDYT?
4. Read through the detailed changes section.
5. Let me know if they have any other concerns or questions.
## Screenies
The new proxy doc:
![image](https://user-images.githubusercontent.com/17786332/219043145-1c75c83e-4191-45a3-acb5-775d05d13862.png)
The new edge doc:
![image](https://user-images.githubusercontent.com/17786332/219043220-1f5daf13-972e-4d56-8aaf-70ff1812863e.png)
2023-02-16 13:36:28 +01:00
|
|
|
} else {
|
|
|
|
return `${repo.url}/blob/${repo.branch}${separator}${url}`;
|
|
|
|
}
|
|
|
|
});
|
|
|
|
|
|
|
|
const replaceImageSrcLink = replace((url, separator) => {
|
|
|
|
return `https://raw.githubusercontent.com/Unleash/${repo.name}/${repo.branch}${separator}${url}`;
|
|
|
|
});
|
|
|
|
|
|
|
|
// matches the URL portion of markdown links like [I go here](path/link "comment")
|
|
|
|
const markdownLink = /(?<=\[.*\]\(\s?)([^\s\)]+)(?=.*\))/g;
|
|
|
|
|
|
|
|
// matches the URL portion of src links that contain an image file type
|
|
|
|
// extension, e.g. src="./.github/img/get-request.png"
|
|
|
|
const imageSrcLink = /(?<=src=")([^")]+\.(png|svg|jpe?g|webp|gif))(?=")/g;
|
|
|
|
|
|
|
|
return content
|
|
|
|
.replaceAll(markdownLink, replaceMarkdownLink)
|
|
|
|
.replaceAll(imageSrcLink, replaceImageSrcLink);
|
|
|
|
};
|
|
|
|
|
|
|
|
module.exports.modifyContent =
|
|
|
|
({
|
|
|
|
getRepoDataFn,
|
|
|
|
filePath = () => {},
|
|
|
|
urlPath,
|
|
|
|
getAdditionalAdmonitions,
|
|
|
|
}) =>
|
|
|
|
(filename, content) => {
|
|
|
|
const data = getRepoDataFn(filename);
|
|
|
|
|
|
|
|
const generationTime = new Date();
|
|
|
|
|
|
|
|
const processedFilename = (() => {
|
2024-03-13 12:30:40 +01:00
|
|
|
const constructed = `${path.join(
|
|
|
|
filePath(data) ?? '',
|
|
|
|
data.slugName,
|
|
|
|
)}.md`;
|
Source proxy and Edge docs from GitHub (#3122)
## What
The main purpose of this PR is to
1. Delete the proxy docs in this repo and replace them with the proxy's
GitHub readme.
2. Add the docs for Unleash Edge.
### Detailed change description
This PR contains a lot of small changes in a large number of files. To
make it easier to get an overview, here's a detailed description of what
happens where:
#### In the `website/docs`directory
Except for the deletion of the proxy doc, all changes in this directory
are rewriting internal links, so that they point to the newly generated
document instead.
#### `package.json` and `yarn.lock`
When including the documentation for Edge, we also want to render the
mermaid diagrams it uses. Docusaurus supports this via a plugin. All
changes in these files are related to installing that plugin.
#### `docusaurus.config.js`
There's two types of changes in this file:
1. Mermaid-related changes: we ask docusaurus to render mermaid in
markdown files and add the plugin
2. Document generation. There's some rewrites to the sdk doc generation
plus an entirely new section that generates docs for Edge and the proxy
#### `sidebars.js`
Two things:
1. Add the edge docs
2. Move both the Edge and the proxy docs up a level, so that they're
directly under "reference docs" instead of nested inside "unleash
concepts".
#### In the `website/remote-content` directory
These are the remote content files. Previously, all of this lived only
in a `readme-fns.js` file, but with the introduction of Edge and proxy
docs, this has been moved into its own directory and refactored into
three files (`shared`, `sdks`, `edge-proxy`).
#### `custom.css`
Style updates to center mermaid diagrams and provide more space around
them.
#### In `static/img`
The image files that were included in the proxy doc and that have been
deleted.
## Why
For two reasons:
1. Reduce duplication for the proxy. Have one source of truth.
2. Add docs for edge.
## Discussion points and review wishes
This is a big PR, and I don't expect anyone to do a line-by-line review
of it, nor do I think that is particularly useful. Instead, I'd like to
ask reviewers to:
1. Visit the [documentation
preview](https://unleash-docs-git-docs-source-proxy-gh-unleash-team.vercel.app/reference/unleash-proxy)
and have a look at both the proxy docs and the Edge docs. Potentially
have a look at the SDK docs too to verify that everything still works.
2. Consider whether they think moving the proxy and edge docs up a level
(in the sidebar) makes sense.
3. Let me know what slug they'd prefer for the Edge docs. I've gone with
`unleash-edge` for now (so that it's
`docs.getunleash.io/reference/unleash-edge`), but we could potentially
also just use `edge`. WDYT?
4. Read through the detailed changes section.
5. Let me know if they have any other concerns or questions.
## Screenies
The new proxy doc:
![image](https://user-images.githubusercontent.com/17786332/219043145-1c75c83e-4191-45a3-acb5-775d05d13862.png)
The new edge doc:
![image](https://user-images.githubusercontent.com/17786332/219043220-1f5daf13-972e-4d56-8aaf-70ff1812863e.png)
2023-02-16 13:36:28 +01:00
|
|
|
|
|
|
|
// ensure the file path does *not* start with a leading /
|
|
|
|
return constructed.charAt(0) === '/'
|
|
|
|
? constructed.slice(1)
|
|
|
|
: constructed;
|
|
|
|
})();
|
|
|
|
|
|
|
|
const processedSlug = (() => {
|
|
|
|
const constructed = path.join(urlPath ?? '', data.slugName);
|
|
|
|
// ensure the slug *does* start with a leading /
|
|
|
|
const prefix = constructed.charAt(0) === '/' ? '' : '/';
|
|
|
|
|
|
|
|
return prefix + constructed;
|
|
|
|
})();
|
|
|
|
|
|
|
|
const additionalAdmonitions = (
|
|
|
|
getAdditionalAdmonitions(data) ?? []
|
|
|
|
).join('\n\n');
|
|
|
|
|
|
|
|
return {
|
|
|
|
filename: processedFilename,
|
|
|
|
content: `---
|
|
|
|
title: ${data.sidebarName}
|
|
|
|
slug: ${processedSlug}
|
2023-10-10 18:11:54 +02:00
|
|
|
custom_edit_url: ${data.repoUrl}/edit/${data.branch}/README.md
|
Source proxy and Edge docs from GitHub (#3122)
## What
The main purpose of this PR is to
1. Delete the proxy docs in this repo and replace them with the proxy's
GitHub readme.
2. Add the docs for Unleash Edge.
### Detailed change description
This PR contains a lot of small changes in a large number of files. To
make it easier to get an overview, here's a detailed description of what
happens where:
#### In the `website/docs`directory
Except for the deletion of the proxy doc, all changes in this directory
are rewriting internal links, so that they point to the newly generated
document instead.
#### `package.json` and `yarn.lock`
When including the documentation for Edge, we also want to render the
mermaid diagrams it uses. Docusaurus supports this via a plugin. All
changes in these files are related to installing that plugin.
#### `docusaurus.config.js`
There's two types of changes in this file:
1. Mermaid-related changes: we ask docusaurus to render mermaid in
markdown files and add the plugin
2. Document generation. There's some rewrites to the sdk doc generation
plus an entirely new section that generates docs for Edge and the proxy
#### `sidebars.js`
Two things:
1. Add the edge docs
2. Move both the Edge and the proxy docs up a level, so that they're
directly under "reference docs" instead of nested inside "unleash
concepts".
#### In the `website/remote-content` directory
These are the remote content files. Previously, all of this lived only
in a `readme-fns.js` file, but with the introduction of Edge and proxy
docs, this has been moved into its own directory and refactored into
three files (`shared`, `sdks`, `edge-proxy`).
#### `custom.css`
Style updates to center mermaid diagrams and provide more space around
them.
#### In `static/img`
The image files that were included in the proxy doc and that have been
deleted.
## Why
For two reasons:
1. Reduce duplication for the proxy. Have one source of truth.
2. Add docs for edge.
## Discussion points and review wishes
This is a big PR, and I don't expect anyone to do a line-by-line review
of it, nor do I think that is particularly useful. Instead, I'd like to
ask reviewers to:
1. Visit the [documentation
preview](https://unleash-docs-git-docs-source-proxy-gh-unleash-team.vercel.app/reference/unleash-proxy)
and have a look at both the proxy docs and the Edge docs. Potentially
have a look at the SDK docs too to verify that everything still works.
2. Consider whether they think moving the proxy and edge docs up a level
(in the sidebar) makes sense.
3. Let me know what slug they'd prefer for the Edge docs. I've gone with
`unleash-edge` for now (so that it's
`docs.getunleash.io/reference/unleash-edge`), but we could potentially
also just use `edge`. WDYT?
4. Read through the detailed changes section.
5. Let me know if they have any other concerns or questions.
## Screenies
The new proxy doc:
![image](https://user-images.githubusercontent.com/17786332/219043145-1c75c83e-4191-45a3-acb5-775d05d13862.png)
The new edge doc:
![image](https://user-images.githubusercontent.com/17786332/219043220-1f5daf13-972e-4d56-8aaf-70ff1812863e.png)
2023-02-16 13:36:28 +01:00
|
|
|
---
|
|
|
|
|
|
|
|
:::info Generated content
|
|
|
|
This document was generated from the README in the [${
|
|
|
|
data.sidebarName
|
|
|
|
} GitHub repository](${data.repoUrl}).
|
|
|
|
:::
|
|
|
|
|
|
|
|
${additionalAdmonitions}
|
|
|
|
|
|
|
|
${replaceLinks({
|
|
|
|
content,
|
|
|
|
repo: { url: data.repoUrl, branch: data.branch, name: data.name },
|
|
|
|
})}
|
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
This content was generated on <time dateTime="${generationTime.toISOString()}">${generationTime.toLocaleString(
|
|
|
|
'en-gb',
|
|
|
|
{ dateStyle: 'long', timeStyle: 'full' },
|
|
|
|
)}</time>
|
|
|
|
`,
|
|
|
|
};
|
|
|
|
};
|
|
|
|
|
|
|
|
module.exports.getUrls = (documents) =>
|
|
|
|
Object.entries(documents).map(
|
|
|
|
([repo, { branch }]) => `${repo}/${branch}/README.md`,
|
|
|
|
);
|