-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathglobal-AGI-project_[HKAIlab].tex
220 lines (154 loc) · 9.98 KB
/
global-AGI-project_[HKAIlab].tex
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
\input{../YKY-preamble.tex}
\setmainfont[BoldFont=Alibaba_Sans_Regular.otf,ItalicFont=Alibaba_Sans_Light_Italic.otf]{Alibaba_Sans_Light.otf}
% \usepackage[backend=biber]{biblatex}
% \bibliography{../AGI-book}
\usepackage[active,tightpage]{preview} % for continuous page(s)
\renewcommand{\PreviewBorder}{0.5cm}
\renewcommand{\thempfootnote}{\arabic{mpfootnote}}
\usepackage[absolute,overlay]{textpos} % for page number on upper left corner
\usepackage{color}
\usepackage{mathtools}
\usepackage[hyperfootnotes=false]{hyperref}
\usepackage{pict2e} % pciture drawing polygon
% \usepackage[backend=biber,style=numeric]{biblatex}
% \bibliography{../AGI-book}
% \renewcommand*{\bibfont}{\footnotesize}
\usetikzlibrary{shapes}
\usepackage[export]{adjustbox} % ??
\usepackage{verbatim} % for comments
% \usepackage{newtxtext,newtxmath} % Times New Roman font
% \titleformat{\subsection}[hang]{\bfseries\large\color{blue}}{}{0pt}{}
% \numberwithin{equation}{subsection}
\newcommand{\underdash}[1]{%
\tikz[baseline=(toUnderline.base)]{
\node[inner sep=1pt,outer sep=10pt] (toUnderline) {#1};
\draw[dashed] ([yshift=-0pt]toUnderline.south west) -- ([yshift=-0pt]toUnderline.south east);
}%
}%
\newcommand\reduline{\bgroup\markoverwith{\textcolor{red}{\rule[-0.5ex]{2pt}{0.4pt}}}\ULon}
%\DeclareSymbolFont{symbolsC}{U}{txsyc}{m}{n}
%\DeclareMathSymbol{\strictif}{\mathrel}{symbolsC}{74}
\DeclareSymbolFont{AMSb}{U}{msb}{m}{n}
\DeclareSymbolFontAlphabet{\mathbb}{AMSb}
% \setmathfont{Latin Modern Math}
\DeclareMathOperator*{\argmin}{arg\,min}
% For cover-page graphics
\def\Put(#1,#2)#3{\leavevmode\makebox(0,0){\put(#1,#2){#3}}}
% \usepackage[most]{tcolorbox}
\tcbset{on line,
boxsep=4pt, left=0pt,right=0pt,top=0pt,bottom=0pt,
colframe=red,colback=pink,
highlight math style={enhanced}
}
\newcommand{\atom}{\vcenter{\hbox{\tcbox{....}}}}
\let\oldtextbf\textbf
\renewcommand{\textbf}[1]{\textcolor{blue}{\oldtextbf{#1}}}
\newcommand{\logic}[1]{{\color{violet}{\textit{#1}}}}
\newcommand{\underconst}{\includegraphics[scale=0.5]{../2020/UnderConst.png}}
\newcommand{\KBsymbol}{\vcenter{\hbox{\includegraphics[scale=1]{../KB-symbol.png}}}}
\newcommand{\token}{\vcenter{\hbox{\includegraphics[scale=1]{token.png}}}}
\newcommand{\proposition}{\vcenter{\hbox{\includegraphics[scale=0.8]{proposition.png}}}}
\newcommand{\circled}[1]{{\textcircled{\sffamily \scriptsize{#1}}}}
\begin{document}
\begin{preview}
\title{\vspace{-1.5cm} \bfseries\color{blue}{\LARGE Global AGI Project}}
% \author{YKY} % Your name
\date{\vspace{-2cm}} % Date, can be changed to a custom date
\setcounter{section}{-1}
\newcounter{mypage}
\setcounter{mypage}{1}
% (1) Circled page number on upper left corner
% \begin{textblock*}{5cm}(2.1cm,2.3cm) % {block width} (coords)
% {\color{red}{\large \textcircled{\small 1}}}
% \end{textblock*}
%\begin{minipage}{\textwidth}
% \setlength{\parskip}{0.4\baselineskip}
%
% \begin{picture}(600,220)
% \put(0,65){\includegraphics[scale=1]{../2021/Genifer-square-logo.png}}
% \definecolor{graygray}{rgb}{.867,0.867,0.867}
% {\color{graygray}\polygon*(-55,-80)(-55,-5)(400,110)(400,-80)}
% \Put(215,-105){\includegraphics[scale=0.08]{../2021/robot1.jpg}}
% \end{picture}
%\end{minipage}
%\end{preview}
%\begin{preview}
\begin{minipage}{\textwidth}
\setlength{\parskip}{0.4\baselineskip}
blah
\end{minipage}
\end{preview}
\begin{preview}
\begin{minipage}{\textwidth}
\setlength{\parskip}{0.4\baselineskip}
\maketitle
\section{About Myself}
\begin{itemize}
\item Hello. This is me, some years ago, in HKU library: \\
\begin{equation}
\nonumber
\vcenter{\hbox{\includegraphics[scale=0.5]{/home/yky/self/AI4U.jpg}}}
\end{equation}
\item You might have noticed I have been applying to every cohort of this program.
\item But this is the first time I pitch on the business idea that is my true passion, which is AGI.
\item In the past attempts, I have tried to disguise AGI under other business ideas because somehow I wanted to approach AGI from an oblique angle, to perhaps squeeze into your incubation program. And also because I don't want to pitch an idea that sounded like blue-sky research or that I'm out of touch with reality. But this is no longer necessary. The time is now ripe for AGI.
\item I have started independent research on AGI in earnest, since 2004. During the past ~20 years there was never a day I did not work on AGI.
\item Hong Kong is a technologically very backwards place (not in the sense that people do not own slick cell phones, but we are not part of the developers of these technologies). Perhaps this is a too-harsh criticism, since basically the rest of the world can be said the same, except for USA, which dominates most high tech industries. For a long time I could not find any partners or sponsors to work on AGI. Not only that I received no help, but often sarcasm and bitterness from my fellow citizens as well.
\item Maybe the number of people interested in AGI in HK is not exactly zero, but if this number is too small, then practically I really cannot find anyone with a similar interest. I have cried over this every day for many years. Perhaps, HKAI Lab has a bit of a responsibility to provide an opportunity to draw such talents together?
\end{itemize}
\end{minipage}
\end{preview}
\begin{preview}
\begin{minipage}{\textwidth}
\setlength{\parskip}{0.4\baselineskip}
\section{AGI}
\begin{itemize}
\item Assuming the reader is not an expert in AGI, I might explain it this way: I think the development of AGI has reached a stage now where ``bottlenecks'' no longer exist. In the past there were so-called ``bottlenecks'' in the sense that theoretical obstacles existed for which we cannot foretell their solutions. But such obstacles no longer exist and we're at a stage of just \textbf{engineering} AGI systems, using tools and techniques that has been demonstrated to work and are reasonably well-understood.
\item At this point it is important to design a \textbf{cognitive architecture} where researchers can clearly understand the internal workings of an AGI, for example, what is ``working memory'' and where is it located in the architecture, etc.
\item I have independently proposed the ideas that \textbf{LLMs} (large language models) are ``world models'' in model-based reinforcement learning, and that Transformers can be seen as performing the function of \textbf{logic} rule-bases. These are the core ingredients of an AGI. Moreover, I proposed a way to treat ``thinking'' as ``actions'' in mental space, unifying thinking and acting under reinforcement learning. My theories have been extensively published on 知乎.com (in addition to the AGI International Conference) which attracted a moderate following. For example: \href{https://zhuanlan.zhihu.com/p/615327294}{AGI 架构综述}
\item Our basic architecture is as follows: (the long-term memory part has been demonstrated to work in Google's recent paper ``\textit{Memorizing Transformers}'')
\begin{equation}
\nonumber
\hspace*{-1.6cm}
\vcenter{\hbox{\includegraphics[scale=0.9]{AGI-architecture-LLM-MBRL-LTM.png}}}
\end{equation}
% \item This is the first prototype architecture we plan to build:
% \begin{equation}
% \nonumber
% \hspace*{-1.6cm}
% \vcenter{\hbox{\includegraphics[scale=1]{LLM-to-RL-transition-architecture.png}}}
% \end{equation}
\end{itemize}
\end{minipage}
\end{preview}
\begin{preview}
\begin{minipage}{\textwidth}
\setlength{\parskip}{0.4\baselineskip}
\section{Why Global?}
\begin{itemize}
\item There is a widely recognized danger of AGI getting too strong and causing human catastrophes:
\begin{equation}
\nonumber
\vcenter{\hbox{\includegraphics[scale=1]{../humanities/AGI-safety-EN.png}}}
\end{equation}
\item The only sensible solution for this problem seems to be to allow a \textbf{diversity} of AGIs trained with different value systems by humans.
\item There is no operable definition that can distinguish between human \textbf{emotions} and machine emotions -- they are just reward functions in reinforcement learning -- implying that as AGI attains higher cognitive powers (including self-consciousness) they could become indistinguishable from human beings. It is important to allow humans to represent their culture and values globally and adequately.
\item Currently the USA (or Anglo-American companies) dominates the global technological landscape, especially in the field of AI. This may pose a threat to diversity if there is a systematic bias towards Anglo-American values. Another weakness may come from the homogeneity of AGI architectures designed by similar companies. It would be beneficial for humanity as a whole if there is a globally collaborative AGI project.
\item \textbf{Hong Kong}'s special position at the intersection of East and West makes it an ideal place to launch this global AGI project. But, many Hong Kongers suffer from a psychological inferiority complex left over from colonialism, that makes them extremely averse to standing up against racism or challenging Anglo-American dominance, even though what I propose to do is positively regarded by many Westerners as the trend of the future.
\end{itemize}
\end{minipage}
\end{preview}
\begin{preview}
\begin{minipage}{\textwidth}
\setlength{\parskip}{0.4\baselineskip}
\section{Our Team / Current State of Our Project}
\begin{itemize}
\item 160 members in WeChat group, mostly students and researchers of AGI, mainly from mainland China
\item An international team is also in the process of forming, on Telegram and Discord. (I used to have an international AGI research team circa 2000's)
\item 1-2 angel investors (from mainland China)
\item AGI prototype planned to complete training in mid-May this year (2023). The main point of the demo is integrating reinforcement learning with LLM according to our AGI theory.
\item We are forming partnerships (indeed, an ecosystem) in business applications of AGI, such as simple businesses utilizing GPT-like services, AIGC, and Web3 technologies (our own AGI project is operated as a DAO -- distributive autonomous organization).
\end{itemize}
\end{minipage}
\end{preview}
\end{document}