Wednesday, October 25, 2017

2017 job H2 3rd post

1025
data uhaul job finished really really fast
hallelujah


1027
experimental result not so good
but no clue

manager saw the search team's post about their new group result
and wanted me to do some query
during query, we found the filtering on search table provided by the search team was too strong
this could cause our training model and prediction pipeline to work weak
hallelujah


do my duty to fix some old pipeline first and then discover improvements?
maybe
you should honor God's words and show responsibility


1030
Hallelujah
peer talked to me and 'accidentally' reminded me of some impact factor again

Hallelujah
m's talk made me discovered that one filtering was too harsh


1031
Hallelujah
in some query, for simplicity and avoid cold start problem, i aggregate 2w+ term each time run the query.
now i met scalability/computation speed problem for my new pipeline
A peer messaged me to fix my pipeline to leave space for others
this also solves my new pipeline's issue.
Amazing


I was trying to talk to yi about my finding
but he just left early
this is good because i wasn't actually ready to talk to him, didn't realize this


1104
through data analysis in the morning, discovered a hard-to-notice bug
Hallelujah!

amazing things happen again and again
peer found an issue, which is also an issue to me. just hidden
Hallelujah!

talked about expectation and impact vs scope with m's manager
now the expectation is more like a good company's expectation. less about end result
Hallelujah!

anyone is helping me on things
Hallelujah!


1116
heard about classification work from a casual talk
this might lead to an important project in my next half
just leave a record here


1129
during debugging one training model command, i didn't think of using softmax is an issue, just thought the issue is from starting transformation on the group side.
i accidentally launched a command with softmax, no group tranformation, previously working training data, and found out the training still fail of low loss.
then realized softmax is an issue.
if it is really the issue, Hallelujah!