Skip to content

Commit e187bb5

Browse files
gitnlpgitnlp
committed
Init
0 parents  commit e187bb5

34 files changed

+48707
-0
lines changed

‎CNAME

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
thegenerality.com

‎agi/about.html

+178
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,178 @@
1+
<!DOCTYPE html>
2+
<html lang="en">
3+
4+
<head>
5+
<script>
6+
window.dataLayer = window.dataLayer || [];
7+
function gtag() { dataLayer.push(arguments); }
8+
gtag('js', new Date());
9+
10+
gtag('config', 'UA-71156606-1');
11+
</script>
12+
<meta charset="utf-8" />
13+
<meta charset="utf-8" />
14+
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
15+
<title>Advancing AGI: Adaptable & Generalizable Intelligence</title>
16+
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" />
17+
<link rel="stylesheet" type="text/css" href="./assets/css/main.css" />
18+
19+
<script type="text/javascript">document.documentElement.className = 'js';</script>
20+
<meta name="referrer" content="no-referrer-when-downgrade" />
21+
22+
<meta property="og:site_name" content="MSR AGI" />
23+
<meta property="og:type" content="website" />
24+
<meta property="og:title" content="Advancing AGI: Adaptable & Generalizable Intelligence" />
25+
<meta property="og:description" content="Our mission is to advance artificial adaptable & generalizable intelligence." />
26+
27+
<meta property="og:description"
28+
content="Our mission is to advance artificial generalizable intelligence." />
29+
<meta property="article:modified_time" content="2019-03-07T02:01:09.000Z" />
30+
<meta property="og:image:width" content="3200" />
31+
<meta property="og:image:height" content="1800" />
32+
33+
<meta name="generator" content="Ghost 5.12" />
34+
<style id="gh-members-styles">
35+
.gh-post-upgrade-cta-content,
36+
.gh-post-upgrade-cta {
37+
display: flex;
38+
flex-direction: column;
39+
align-items: center;
40+
font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Oxygen, Ubuntu, Cantarell, 'Open Sans', 'Helvetica Neue', sans-serif;
41+
text-align: center;
42+
width: 100%;
43+
color: #ffffff;
44+
font-size: 16px;
45+
}
46+
47+
.gh-post-upgrade-cta-content {
48+
border-radius: 8px;
49+
padding: 40px 4vw;
50+
}
51+
52+
.gh-post-upgrade-cta h2 {
53+
color: #ffffff;
54+
font-size: 28px;
55+
letter-spacing: -0.2px;
56+
margin: 0;
57+
padding: 0;
58+
}
59+
60+
.gh-post-upgrade-cta p {
61+
margin: 20px 0 0;
62+
padding: 0;
63+
}
64+
65+
.gh-post-upgrade-cta small {
66+
font-size: 16px;
67+
letter-spacing: -0.2px;
68+
}
69+
70+
.gh-post-upgrade-cta a {
71+
color: #ffffff;
72+
cursor: pointer;
73+
font-weight: 500;
74+
box-shadow: none;
75+
text-decoration: underline;
76+
}
77+
78+
.gh-post-upgrade-cta a:hover {
79+
color: #ffffff;
80+
opacity: 0.8;
81+
box-shadow: none;
82+
text-decoration: underline;
83+
}
84+
85+
.gh-post-upgrade-cta a.gh-btn {
86+
display: block;
87+
background: #ffffff;
88+
text-decoration: none;
89+
margin: 28px 0 0;
90+
padding: 8px 18px;
91+
border-radius: 4px;
92+
font-size: 16px;
93+
font-weight: 600;
94+
}
95+
96+
.gh-post-upgrade-cta a.gh-btn:hover {
97+
opacity: 0.92;
98+
}
99+
</style>
100+
<script defer src="./assets/js/cards.min.js"></script>
101+
<style>
102+
:root {
103+
--ghost-accent-color: #15171A;
104+
}
105+
</style>
106+
<link rel="stylesheet" type="text/css" href="./assets/css/cards.min.css">
107+
</head>
108+
109+
<body>
110+
111+
<header>
112+
<nav class="nav container" data-url="/blog/">
113+
<div class="nav-row row align-items-center">
114+
<div class="d-none d-sm-block col-sm nav-symbol-wrap">
115+
<a href="./index.html"> Home </a>
116+
</div>
117+
<div class="col col-sm-auto">
118+
<ul class="d-flex flex-row align-items-center justify-content-between small-caps">
119+
<div class="d-sm-none nav-symbol-wrap">
120+
</div>
121+
122+
<!--li class="ml-sm-1.75" style="margin-top:0.5px"><a class="nav-link" href="overview.html"
123+
data-slug="research">Overview</a></li-->
124+
125+
<li class="ml-sm-1.75" style="margin-top:0.5px"><a class="nav-link" href="research.html"
126+
data-slug="research">Research</a></li>
127+
128+
<li class="ml-sm-1.75" style="margin-top:0.5px"><a class="nav-link" href="blog.html"
129+
data-slug="blog">Blog</a></li>
130+
131+
<li class="ml-sm-1.75" style="margin-top:0.5px"><a class="nav-link active" href="about.html"
132+
data-slug="about">About</a></li>
133+
</ul>
134+
</div>
135+
</div>
136+
</nav>
137+
138+
</header>
139+
<div class="container mt-4" style="text-align:justify">
140+
<p>
141+
Our mission is to advance artificial general (<b>adaptable & generalizable</b>) <b>intelligence</b>.
142+
Among other efforts, we are committed to the research and development of a general-purpose foundation model that can be systematically adapted and generalized to a broad set of tasks with general modalities as input, aiming to realize the grand vision of <b>AGI-as-a-Service</b>.
143+
</p>
144+
<br>
145+
146+
<p>As part of the mission-focused research, our work on Foundation Models has been pushing large-scale AI and The Big <b>Convergence</b> of large-scale pre-training across tasks, languages, and modalities, including <font color="blue">UniLM</font>(-2) for language model pre-training; InfoXLM, <font color="blue">XLM-E</font> for multilingual pre-training; <font color="blue">BEiT</font>(-2) for vision pre-training; WavLM, SpeechLM for speech pre-training; <font color="blue">BEiT-3</font> for multimodal pre-training; <font color="blue">Layout(X)LM(-2/3)</font> as the first multimodal document foundation model; <font color="blue">MetaLM</font> as the general-purpose foundation model; <font color="blue">Multiway Transformers</font> for multimodal modeling and <font color="blue">Magneto</font> (Foundation Transformers) for true general-purpose modeling, to name a few. Also, our research has been pushing fundamental AI, such as the <font color="blue">OpenScale</font> initiative which focuses on fundamental research to improve modeling generality and capability as well as training stability and efficiency of scaling Transformers at any scale, including <font color="blue">DeepNet</font>, <font color="blue">Magneto</font> (Foundation Transformers), and X-MoE. We also develop effective and efficient approaches to deploying large AI models in practice, including <font color="blue">MiniLM</font>(-2), <font color="blue">xTune</font>, EdgeFormer, and <font color="blue">Aggressive Decoding</font>. In addition to the research achievements, these models are significant parts of Microsoft's own family of large AI (foundation) models powering language and multimodal tasks and scenarios across products in Microsoft. Moreover, our research tops public benchmarks and leaderboards across language (GLUE, XTREME), vision (ADE20k, COCO), speech (SUPERB), and multimodal (NLVR2, VQAv2) tasks, and hugely contributes to the open source community through GitHub and Hugging Face.
147+
More information about our <a href="research.html"><font color="blue">Research</font></a> and <a href="overview.html"><font color="blue">Highlights</font></a>.</p>
148+
149+
<br>
150+
<br>
151+
152+
<!--h2 class="mb-2">Join us</h2-->
153+
154+
<p>
155+
We are hiring at all levels (including FTE researchers and interns)! If you are interested in working with us on Foundation Models (aka large-scale pre-trained models) and AGI, NLP, MT, Speech, Document AI and Multimodal AI,
156+
please send your resume to <a href = "mailto: [email protected]"><u>[email protected]</u></a>.
157+
</p>
158+
<br>
159+
160+
</div>
161+
162+
163+
164+
<footer class="footer container medium-xsmall-copy line-height-1.6">
165+
166+
<div class="row align-items-center mb-0.125">
167+
<div class="col-12 col-md mb-0.5">
168+
<a class="fade" style="margin-top:1px" href="/">&copy; 2022</a>
169+
</div>
170+
</div>
171+
</footer>
172+
173+
<script type="text/javascript" src="./assets/js/main.min.js"></script>
174+
175+
176+
</body>
177+
178+
</html>

‎agi/assets/css/cards.min.css

+1
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)