forked from ytsaurus/ytsaurus
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
CHYT-700: Include simdjson to clickhouse build
19ab39c72bdf4b7a36759d391055c14309003306
- Loading branch information
buyval01
committed
Sep 9, 2024
1 parent
8b593c1
commit a0f725b
Showing
228 changed files
with
32,381 additions
and
3 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| # List of authors for copyright purposes, in no particular order | ||
| Daniel Lemire | ||
| Geoff Langdale | ||
| John Keiser |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,42 @@ | ||
| # This file was generated by the YaTool build system (https://github.com/yandex/yatool), | ||
| # from a source YaTool build configuration provided in ya.make files. | ||
| # | ||
| # If the repository supports both CMake and ya build configurations, please modify both of them. | ||
| # | ||
| # If only CMake build configuration is supported then modify only CMake files and note that only | ||
| # simple modifications are allowed like adding source-files to targets or adding simple properties | ||
| # like target_include_directories. These modifications will be ported to original ya.make files | ||
| # by maintainers. Any complex modifications which can't be easily ported back to the ya build | ||
| # system may be rejected. | ||
| # | ||
| # Please refer to the build instructions in the repository for more information about manual | ||
| # changes in this file. | ||
|
|
||
| find_package(linux-headers-generic REQUIRED) | ||
|
|
||
| add_library(contrib-libs-simdjson) | ||
|
|
||
|
|
||
| target_compile_options(contrib-libs-simdjson PRIVATE | ||
| -DSIMDJSON_AVX512_ALLOWED=1 | ||
| -DSIMDJSON_UTF8VALIDATION=1 | ||
| $<IF:$<CXX_COMPILER_ID:MSVC>,,-Wno-everything> | ||
| ) | ||
|
|
||
| target_include_directories(contrib-libs-simdjson PUBLIC | ||
| ${PROJECT_SOURCE_DIR}/contrib/libs/simdjson/include | ||
| ) | ||
|
|
||
| target_include_directories(contrib-libs-simdjson PRIVATE | ||
| ${PROJECT_SOURCE_DIR}/contrib/libs/simdjson/src | ||
| ) | ||
|
|
||
| target_link_libraries(contrib-libs-simdjson PUBLIC | ||
| linux-headers-generic::linux-headers-generic | ||
| contrib-libs-cxxsupp | ||
| ) | ||
|
|
||
| target_sources(contrib-libs-simdjson PRIVATE | ||
| ${PROJECT_SOURCE_DIR}/contrib/libs/simdjson/src/simdjson.cpp | ||
| ) | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,103 @@ | ||
| Contributing | ||
| ============ | ||
|
|
||
| The simdjson library is an open project written in C++. Contributions are invited. Contributors | ||
| agree to the project's license. | ||
|
|
||
| We have an extensive list of issues, and contributions toward any of these issues is invited. | ||
| Contributions can take the form of code samples, better documentation or design ideas. | ||
|
|
||
| In particular, the following contributions are invited: | ||
|
|
||
| - The library is focused on performance. Well-documented performance optimization are invited. | ||
| - Fixes to known or newly discovered bugs are always welcome. Typically, a bug fix should come with | ||
| a test demonstrating that the bug has been fixed. | ||
| - The simdjson library is advanced software and maintainability and flexibility are always a | ||
| concern. Specific contributions to improve maintainability and flexibility are invited. | ||
|
|
||
| We discourage the following types of contributions: | ||
|
|
||
| - Code refactoring. We all have our preferences as to how code should be written, but unnecessary | ||
| refactoring can waste time and introduce new bugs. If you believe that refactoring is needed, you | ||
| first must explain how it helps in concrete terms. Does it improve the performance? | ||
| - Applications of new language features for their own sake. Using advanced C++ language constructs | ||
| is actually a negative as it may reduce portability (to old compilers, old standard libraries and | ||
| systems) and reduce accessibility (to programmers that have not kept up), so it must be offsetted | ||
| by clear gains like performance or maintainability. When in doubt, avoid advanced C++ features | ||
| (beyond C++11). | ||
| - Style formatting. In general, please abstain from reformatting code just to make it look prettier. | ||
| Though code formatting is important, it can also be a waste of time if several contributors try to | ||
| tweak the code base toward their own preference. Please do not introduce unneeded white-space | ||
| changes. | ||
|
|
||
| In short, most code changes should either bring new features or better performance. We want to avoid unmotivated code changes. | ||
|
|
||
|
|
||
| Specific rules | ||
| ---------- | ||
|
|
||
| We have few hard rules, but we have some: | ||
|
|
||
| - Printing to standard output or standard error (`stderr`, `stdout`, `std::cerr`, `std::cout`) in the core library is forbidden. This follows from the [Writing R Extensions](https://cran.r-project.org/doc/manuals/R-exts.html) manual which states that "Compiled code should not write to stdout or stderr". | ||
| - Calls to `abort()` are forbidden in the core library. This follows from the [Writing R Extensions](https://cran.r-project.org/doc/manuals/R-exts.html) manual which states that "Under no circumstances should your compiled code ever call abort or exit". | ||
| - All source code files (.h, .cpp) must be ASCII. | ||
| - All C macros introduced in public headers need to be prefixed with either `SIMDJSON_` or `simdjson_`. | ||
| - We avoid trailing white space characters within lines. That is, your lines of code should not terminate with unnecessary spaces. Generally, please avoid making unnecessary changes to white-space characters when contributing code. | ||
|
|
||
| Tools, tests and benchmarks are not held to these same strict rules. | ||
|
|
||
| General Guidelines | ||
| ---------- | ||
|
|
||
| Contributors are encouraged to : | ||
|
|
||
| - Document their changes. Though we do not enforce a rule regarding code comments, we prefer that non-trivial algorithms and techniques be somewhat documented in the code. | ||
| - Follow as much as possible the existing code style. We do not enforce a specific code style, but we prefer consistency. We avoid contractions (isn't, aren't) in the comments. | ||
| - Modify as few lines of code as possible when working on an issue. The more lines you modify, the harder it is for your fellow human beings to understand what is going on. | ||
| - Tools may report "problems" with the code, but we never delegate programming to tools: if there is a problem with the code, we need to understand it. Thus we will not "fix" code merely to please a static analyzer. | ||
| - Provide tests for any new feature. We will not merge a new feature without tests. | ||
| - Run before/after benchmarks so that we can appreciate the effect of the changes on the performance. | ||
|
|
||
| Pull Requests | ||
| -------------- | ||
|
|
||
| Pull requests are always invited. However, we ask that you follow these guidelines: | ||
|
|
||
| - It is wise to discuss your ideas first as part of an issue before you start coding. If you omit this step and code first, be prepared to have your code receive scrutiny and be dropped. | ||
| - Users should provide a rationale for their changes. Does it improve performance? Does it add a feature? Does it improve maintainability? Does it fix a bug? This must be explicitly stated as part of the pull request. Do not propose changes based on taste or intuition. We do not delegate programming to tools: that some tool suggested a code change is not reason enough to change the code. | ||
| 1. When your code improves performance, please document the gains with a benchmark using hard numbers. | ||
| 2. If your code fixes a bug, please either fix a failing test, or propose a new test. | ||
| 3. Other types of changes must be clearly motivated. We openly discourage changes with no identifiable benefits. | ||
| - Changes should be focused and minimal. You should change as few lines of code as possible. Please do not reformat or touch files needlessly. | ||
| - New features must be accompanied by new tests, in general. | ||
| - Your code should pass our continuous-integration tests. It is your responsibility to ensure that your proposal pass the tests. We do not merge pull requests that would break our build. | ||
| - An exception to this would be changes to non-code files, such as documentation and assets, or trivial changes to code, such as comments, where it is encouraged to explicitly ask for skipping a CI run using the `[skip ci]` prefix in your Pull Request title **and** in the first line of the most recent commit in a push. Example for such a commit: `[skip ci] Fixed typo in power_of_ten's docs` | ||
| This benefits the project in such a way that the CI pipeline is not burdened by running jobs on changes that don't change any behavior in the code, which reduces wait times for other Pull Requests that do change behavior and require testing. | ||
|
|
||
| If the benefits of your proposed code remain unclear, we may choose to discard your code: that is not an insult, we frequently discard our own code. We may also consider various alternatives and choose another path. Again, that is not an insult or a sign that you have wasted your time. | ||
|
|
||
| Style | ||
| ----- | ||
|
|
||
| Our formatting style is inspired by the LLVM style. | ||
| The simdjson library is written using the snake case: when a variable or a function is a phrase, each space is replaced by an underscore character, and the first letter of each word written in lowercase. Compile-time constants are written entirely in uppercase with the same underscore convention. | ||
|
|
||
| Code of Conduct | ||
| --------------- | ||
|
|
||
| Though we do not have a formal code of conduct, we will not tolerate bullying, bigotry or | ||
| intimidation. Everyone is welcome to contribute. If you have concerns, you can raise them privately with the core team members (e.g., D. Lemire, J. Keiser). | ||
|
|
||
| We welcome contributions from women and less represented groups. If you need help, please reach out. | ||
|
|
||
| Consider the following points when engaging with the project: | ||
|
|
||
| - We discourage arguments from authority: ideas are discusssed on their own merits and not based on who stated it. | ||
| - Be mindful that what you may view as an aggression is maybe merely a difference of opinion or a misunderstanding. | ||
| - Be mindful that a collection of small aggressions, even if mild in isolation, can become harmful. | ||
|
|
||
| Getting Started Hacking | ||
| ----------------------- | ||
|
|
||
| An overview of simdjson's directory structure, with pointers to architecture and design | ||
| considerations and other helpful notes, can be found at [HACKING.md](HACKING.md). |
Oops, something went wrong.