Implementation Step 2(a):
Upload input files

This step involves uploading the list of users and sessions that should be included in this report, and their group information, if applicable. The data is uploaded as one or more ndjson files.

  • Upload the ndjson files with an HTTP PUT request to the input_files URL(s) returned in step 1.
  • Set the Content-Type: application/x-www-form-urlencoded header on the PUT request.
  • Set the Expect: 100-continue header if your HTTP client supports it, to avoid transmitting unneccessary ndjson data in certain error cases. See the Expect-continue handshake optimisation introduced in HTTP 1.1.

The signed input_files URLs expire 60 minutes after they're issued. If one or more signed URLs have expired, start again from step 1 to initialize a new dataset_id.

The expected format of your ndjson file can be found in the documentation for the dataset type you are creating:

The data can be uploaded using a simple Curl call, or the HTTP client of your choice. For example, the following command will upload the users.ndjson file from a Curl-enabled terminal:

$ curl --request PUT --header "Expect: 100-continue" --header "Content-Type: application/x-www-form-urlencoded" --data-binary "@users.ndjson" "https://learnosity-reportdatasets-va.s3.amazonaws.com/reports/0034/activity-summary-by-group/a951cc14-0316-4c12-bb13-1f386338a094/infiles/0.ndjson?AWSAccessKeyId=AKIAJB5XQL2VQTD4KG6Q&Expires=1484208440&Signature=lEANv4k3aIK1CelRhXsYHgXNTDQ%3D"

To debug issues with constructing a valid PUT request, it may help to inspect the raw request content and compare it to the following sample request produced by Curl:

PUT https://learnosity-reportdatasets-va.s3.amazonaws.com/reports/0034/sessions-summary-by-group/a951cc14-0316-4c12-bb13-1f386338a094/infiles/0.ndjson?AWSAccessKeyId=AKIAJB5XQL2VQTD4KG6Q&Expires=1484204382&Signature=3zqRDJvtif%2B5wYmdCsWXHZLCkrM%3D HTTP/1.1
Host: learnosity-reportdatasets-va.s3.amazonaws.com
User-Agent: curl/7.43.0
Accept: */*
Expect: 100-continue
Content-Type: application/x-www-form-urlencoded
Content-Length: 10376

{"user_id":"bart_simpson",           "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"milhouse_vanhouten",     "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"nelson_muntz",           "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"martin_prince",          "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"wendell_borton",         "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"lewis_clark",            "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"sherri_mackleberry",     "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"terri_mackleberry",      "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"adrian_belew",           "group_path":["Simpson","Springfield High","7_krabappel"]}
{"user_id":"lisa_simpson",           "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"ralph_wiggum",           "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"janey_powell",           "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"allison_taylor",         "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"alex_whitney",           "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"francine_rhenquist",     "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"hubert_wong",            "group_path":["Simpson","Springfield High","7_hoover"]}
{"user_id":"maggie_simpson",         "group_path":["Simpson","Cypress Creek College","7_doyle"]}
{"user_id":"dot_warner",             "group_path":["Simpson","Cypress Creek College","7_doyle"]}
{"user_id":"gordy_scribe",           "group_path":["Simpson","Cypress Creek College","7_doyle"]}
{"user_id":"warren_watson",          "group_path":["Simpson","Cypress Creek College","7_doyle"]}
{"user_id":"melvin_earnest",         "group_path":["Simpson","Cypress Creek College","7_doyle"]}
{"user_id":"gary_gray",              "group_path":["Simpson","Cypress Creek College","7_doyle"]}
{"user_id":"draco_malfoy",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"vincent_crabbe",         "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"gregory_goyle",          "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"pansy_parkinson",        "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"blaise_zabini",          "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"marcus_flint",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"terence_higgs",          "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"adrian_pucey",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"tracey_davis",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"hestia_carrow",          "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"flora_carrow",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"zubeida_khan",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"zoe_accrington",         "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"yurika_haneda",          "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"yatin_bhagat",           "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"viola_richmond",         "group_path":["Simpson","Hogwarts School","7_slytherin"]}
{"user_id":"harry_potter",           "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"hermione_granger",       "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"ron_weasley",            "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"dean_thomas",            "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"seamus_finnagin",        "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"neville_longbottom",     "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"parvati_patil",          "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"fred_weasley",           "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"george_weasley",         "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"ginny_weasley",          "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"angelina_johnson",       "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"katie_bell",             "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"oliver_wood",            "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"collin_creevy",          "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"dennis_creevy",          "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"percey_weasley",         "group_path":["Simpson","Hogwarts School","7_gryffindor"]}
{"user_id":"pomona_sprout",          "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"silvanus_kettleburn",    "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"newton_scamander",       "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"nymphadora_tonks",       "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"cedric_diggory",         "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"ernie_macmillan",        "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"hannah_abbott",          "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"justin_finchfletchley",  "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"susan_bones",            "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"zacharias_smith",        "group_path":["Simpson","Hogwarts School","7_hufflepuff"]}
{"user_id":"luna_lovegood",          "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"marcus_belby",           "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"cho_chang",              "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"myrtle_warren",          "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"padma_patil",            "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"terry_boot",             "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"michael_corner",         "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"roger_davies",           "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"anthony_goldstein",      "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"marietta_edgecombe",     "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"robert_hilliard",        "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"penelope_clearwater",    "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"lisa_turpin",            "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"isobel_macdougal",       "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"mandy_brocklehurst",     "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"nanette_desford",        "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"maria_glossop",          "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"filius_flitwick",        "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"millicent_bagnold",      "group_path":["Simpson","Hogwarts School","7_ravenclaw"]}
{"user_id":"walter_white",           "group_path":["Walter","J. P. Wynne High School","7_broker"]}
{"user_id":"skyler_white",           "group_path":["Walter","J. P. Wynne High School","7_broker"]}
{"user_id":"jesse_pinkman",          "group_path":["Walter","J. P. Wynne High School","7_broker"]}
{"user_id":"hank_schrader",          "group_path":["Walter","J. P. Wynne High School","7_broker"]}
{"user_id":"saul_goodman",           "group_path":["Walter","J. P. Wynne High School","7_broker"]}
{"user_id":"john_bender",            "group_path":["Walter","Shermer High School","7_vernon"]}
{"user_id":"claire_standish",        "group_path":["Walter","Shermer High School","7_vernon"]}
{"user_id":"andy_clark",             "group_path":["Walter","Shermer High School","7_vernon"]}
{"user_id":"brian_johnson",          "group_path":["Walter","Shermer High School","7_vernon"]}
{"user_id":"allison_reynolds",       "group_path":["Walter","Shermer High School","7_vernon"]}
{"user_id":"kat_stratford",          "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"patrick_verona",         "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"cameron_james",          "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"bianca_stratford",       "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"joey_donner",            "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"katherina_minola",       "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"bianca_minola",          "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"baptista_minola",        "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"petruchio_smith",        "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"gremio_jones",           "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"lucentio_williams",      "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"hortensio_brown",        "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"grumio_wilson",          "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"tranio_taylor",          "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"biondello_johnson",      "group_path":["Walter","Padua High School","7_morgan"]}
{"user_id":"vincentio_white",        "group_path":["Walter","Padua High School","7_morgan"]}