Add task in allinone (#11226)

* add task

* update prompt

* modify typos

* add more cases in summarize

* Make the summarize & QA prompt preprocessing as a util function

python/llm/dev/benchmark/all-in-one/config.yaml

@@ -39,3 +39,4 @@ use_fp16_torch_dtype: True # whether use fp16 for non-linear layer (only availab
 n_gpu: 2 # number of GPUs to use (only available now for "pipeline_parallel_gpu" test_api)
 lookahead: 3
 max_matching_ngram_size: 2
+task: 'continuation' # when test_api is "transformer_int4_fp16_lookahead_gpu", task could be 'QA', 'continuation' or 'summarize' 

python/llm/dev/benchmark/all-in-one/prompt/QA/orca_401.txt

@@ -0,0 +1,6 @@
+<s>[INST] <<SYS>>
+
+<</SYS>>
+
+Q:Information:  - Mark Andes (born February 19, 1948) is an American musician, known for his work as a bassist with Canned Heat, Spirit, Jo Jo Gunne, Firefall, Heart, and Mirabal.  - Jo Jo Gunne is a rock band, formed in Los Angeles, California, in 1971 by Jay Ferguson (keyboards, vocals and guitar) and Mark Andes (bass guitar and vocals) after they had left Spirit. The group's name is derived from "Jo Jo Gunne", a Chuck Berry song that peaked at #83 as a single in November 1958.  - A county seat is an administrative center, seat of government, or capital city of a county or civil parish. The term is used in the United States, Canada, Romania, China and Taiwan. In the United Kingdom and Ireland, county towns have a similar function.  - The 2010 United States Census, (known as "Census 2010"), is the twenty-third and currently most recent United States national census. National Census Day, the reference day used for the census, was April 1, 2010. As part of a drive to increase the count's accuracy, 635,000 temporary enumerators were hired. The population of the United States was counted as 308,745,538, a 9.7% increase from the 2000 Census.  - Rock Band is a series of music video games developed by Harmonix and MTV Games, and distributed by Electronic Arts for the Nintendo DS, iOS, PlayStation 2, PlayStation 3, PSP, Wii, Xbox One and Xbox 360 game systems. The series, inspired by Harmonix's previous efforts on the "Guitar Hero" series, allows up to four players to simulate the performance of popular rock music songs by playing with controllers modeled after musical instruments. Players can play the lead guitar, bass guitar, keyboard, and drums parts to songs, as well as sing into a USB microphone. Players are scored on their ability to match scrolling musical notes while playing instruments, and by their ability to match the singer's pitch on vocals.  - Oklahoma (Cherokee: "Asgaya gigageyi" /  ; or transliterated from English as  ("òàlàhoma"), Pawnee: "Uukuhuúwa", Cayuga: "Gahnawiyogeh") is a state located in the South Central United States. Oklahoma is the 20th-most extensive and the 28th-most populous of the 50 United States. The state's name is derived from the Choctaw words "okla" and "humma", meaning "red people". It is also known informally by its nickname, "The Sooner State", in reference to the non-Native settlers who staked their claims on the choicest pieces of land before the official opening date, and the Indian Appropriations Act of 1889, which opened the door for white settlement in America's Indian Territory. The name was settled upon statehood, Oklahoma Territory and Indian Territory were merged and Indian was dropped from the name. On November 16, 1907, Oklahoma became the 46th state to enter the union. Its residents are known as "Oklahomans", or informally "Okies", and its capital and largest city is Oklahoma City.  - Texas is the second largest state in the United States by both area and population. Geographically located in the south central part of the country, Texas shares borders with the U.S. states of Louisiana to the east, Arkansas to the northeast, Oklahoma to the north, New Mexico to the west, and the Mexican states of Chihuahua, Coahuila, Nuevo León, and Tamaulipas to the southwest, while the Gulf of Mexico is to the southeast.  - Nuevo León, or New Leon, officially the Free and Sovereign State of Nuevo León, is one of the 31 states which, with Mexico City, compose the 32 Federal Entities of Mexico. It is divided into 51 municipalities and its capital city is Monterrey.  - Dallas is a major city in the state of Texas and is the largest urban center of the fourth most populous metropolitan area in the United States. The city proper ranks ninth in the U.S. and third in Texas after Houston and San Antonio. The city's prominence arose from its historical importance as a center for the oil and cotton industries, and its position along numerous railroad lines. The bulk of the city is in Dallas County, of which it is the county seat; however, sections of the city are located in Collin, Denton, Kaufman, and Rockwall counties. According to the 2010 United States Census, the city had a population of 1,197,816. The United States Census Bureau's estimate for the city's population increased to 1,300,092 as of July 1, 2015.  - San Antonio (Spanish for "Saint Anthony"), officially the City of San Antonio, is the seventh-most populated city in the United States and the second-most populous city in the state of Texas, with a population of 1,409,019. It was the fastest growing of the top 10 largest cities in the United States from 2000 to 2010, and the second from 1990 to 2000. The city straddles South Texas and Central Texas and is on the southwestern corner of an urban megaregion known as the Texas Triangle.  - Jimmie Randall ( born Dallas , Texas , February 14 , 1949 ) is a bass guitarist best known for his work with Jo Jo Gunne .  - The guitar is a musical instrument classified as a string instrument with anywhere from four to 18 strings, usually having six. The sound is projected either acoustically, using a hollow wooden or plastic and wood box (for an acoustic guitar), or through electrical amplifier and a speaker (for an electric guitar). It is typically played by strumming or plucking the strings with the fingers, thumb and/or fingernails of the right hand or with a pick while fretting (or pressing against the frets) the strings with the fingers of the left hand. The guitar is a type of chordophone, traditionally constructed from wood and strung with either gut, nylon or steel strings and distinguished from other chordophones by its construction and tuning. The modern guitar was preceded by the gittern, the vihuela, the four-course Renaissance guitar, and the five-course baroque guitar, all of which contributed to the development of the modern six-string instrument.  - Coahuila, formally Coahuila de Zaragoza, officially the Free and Sovereign State of Coahuila de Zaragoza, is one of the 31 states which, along with Mexico City, compose the 32 Federal Entities of Mexico. The state is located in Northeastern Mexico on the US border.  - Tamaulipas, officially the Free and Sovereign State of Tamaulipas, is one of the 31 states which, with Mexico City, comprise the 32 Federal Entities of Mexico. It is divided into 43 municipalities and its capital city is Ciudad Victoria. The capital city was named after Guadalupe Victoria, the first President of Mexico.  - Charles Edward Anderson "Chuck" Berry (born October 18, 1926) is an American guitarist, singer and songwriter and is one of the pioneers of rock and roll music. With songs such as "Maybellene" (1955), "Roll Over Beethoven" (1956), "Rock and Roll Music" (1957) and "Johnny B. Goode" (1958), Berry refined and developed rhythm and blues into the major elements that made rock and roll distinctive, with lyrics focusing on teen life and consumerism and music featuring guitar solos and showmanship that were a major influence on subsequent rock music.  - New Mexico is a state located in the southwestern region of the United States of America. It was admitted to the union as the 47th state on January 6, 1912. It is usually considered one of the Mountain States. New Mexico is fifth by area, the 36th. Given the information above, choose from the list below the object entity that exhibits the relation 'occupation' with the subject 'jimmie randall'.  Choices: - band  - canada  - construction  - count  - guitarist  - hero  - major  - musician  - official  - saint  - singer  - songwriter  - sovereign  - speaker  - united states of america
+A: [/INST]