Live data from Hacker News

Frustration project: Automate data entry into PeopleSoft with Selenium

github.com

41–50 of 51 posts

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#41
IMHO it's usually better to write a WebExtension instead of using Selenium, since you have more control over the browser, can intercept and modify network requests, can access the DOM from JavaScript while being protected from the page altering the environment, and can ship the code as a browser add-on, while still being able to communicate with native apps.

Only downside is that you can't drive old IE and mobile browsers except for Firefox for Android.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#42
post #6

There is an entire class of business problems that can be solved using Selenium. I don’t love that raw http connections are the universal API, but at least it’s a tool in our belts when these companies provide lackluster or zero proper interfaces.

There's a whole class of solutions beyond Selenium that automates not just web apps but all apps. It's going under the name of "Robotic Process Automation" and people really like it because they're not dependent on their software vendor to get basic integrations done.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#43
post #36
post #8

Earlier quoted context omitted.

RPA (Robotic Process Automation) is a big category of tools that can be summarised as ‘automating boring stuff’. You often see it used for repetitive data entry, e.g. 1. Load excel sheet from X:\... 2. Login to Y 3. For each row navigate to ... then enter data 4. Submit, if there’s a validation error add it to and excel workbook 5. Email exception report to ...

What software is generally used for this? Is there anything available for the average person that doesn’t require spending a small fortune?

Uipath and automation anywhere seem to be big players with community/free starter editions. PWC (who are spearheading the RPA at $work) seem to have decreed that all their staff are going to use uipath worldwide.

There are a handful of open source RPA tools, but I don’t think there’s a breakthrough project yet.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#44
post #21

Selenium leaves trace in HTTP requests, so its use is quite detectable. The authors of PeopleSoft can include Selenium detection in their products, disallowing your automation scripts. Why not use GreaseMonkey instead?

Do you have any more information about this trace in HTTP requests? My understanding was that it was the _browser_ doing the requests; Selenium was just driving the browser.

Yes, here is info: https://stackoverflow.com/questions/33225947/can-a-website-d...

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#45
post #29
post #23

"Peoplesoft is a curse on humanity" I would love to know the story of how this wretched piece of software seems to have embedded itself into nearly every college and university in the United States.

No surprise that it is backed by Oracle. The sales people at Oracle are really good at getting technology inept people/businesses into multi year contracts. Once they started citing the list of features in their hundred slide presentation, the administrator stood no chance.

PeopleSoft was one of the larger players, at least in education, well before Oracle bought them. There's really (or at least there was when I was involved in higher education) only 3 main players at that level. And trust me, each option you had was bad in its own way.

The problem is that these products started out much smaller, and grew to fill the needs, although not necessarily as nicely as you might like. So now when it's time to put out a new bid, there's just the handful of vendors who can check off all the boxes for what the current system does. And integration with other systems is always a pain - even today it often includes csv or tab-delimited files that get sent to ftp sites for batch processing!

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#46

I'm always interested in clever use cases for Selenium. It seems like "automating boring stuff using Selenium" should be a bigger category than it is - and use cases that can do it profitably are always fascinating.

> "automating boring stuff using Selenium"

With an Appendix for the sites that block using Selenium.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#47
post #10

#FunFact: I started the Selenium project. My first job out of college was at PeopleSoft. I left PeopleSoft and went "in-house" as the PeopleSoft admin at ThoughtWorks. A few years later, Selenium came out as a side-project for another internal system we needed. But when we were rolling out Selenium and dreaming up "world domination plans", one of my mine was to get a copy of Selenium to ship with every copy of People…

> Selenium came out as a side-project for another internal system we needed.

What kind of system? I had thought that selenium was created to TDD web development front-end.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#48
post #36
post #8

Earlier quoted context omitted.

RPA (Robotic Process Automation) is a big category of tools that can be summarised as ‘automating boring stuff’. You often see it used for repetitive data entry, e.g. 1. Load excel sheet from X:\... 2. Login to Y 3. For each row navigate to ... then enter data 4. Submit, if there’s a validation error add it to and excel workbook 5. Email exception report to ...

What software is generally used for this? Is there anything available for the average person that doesn’t require spending a small fortune?

Azure LogicApps are good for these kind of silly integrations, if it has a connector for it then it's a piece of cake.

They have a pretty limited use case though.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#49
post #17
post #15

I would love to hear any more you have to say about the genetic algorithms you use to help with scheduling.

Ah yes, the genetric algorithm (GA). Well, in short, scheduling personnel is a very visible, policital, and important job. It affects people's lives, and has to be done farily and correctly. I did my best (by hand) for a few years (scheduling 50ish professors into 200 class sections), and I knew I was doing a bad job, but had no choice. It would take 2 weeks to do, because I could only mentally handle working on such…

Fascinating! I am going to try that. I’ve been trying to teach myself SAT solvers and constraint systems to approach the problem at my junior college.

Re: Frustration project: Automate data entry into PeopleSoft with Selenium

#50
post #16

Earlier quoted context omitted.

If anyone happens to know of a particularly good article on this for non-javascript (but technical) people, please post.

Please clarify--are you looking to understand how browser events work without learning about the DOM and/or Javascript?

I suppose something along the lines of Chrome debugging for programmers who aren't javascript developers...undoubtedly there are some fundamentals you would have to become knowledgeable in, as with any technology.
Post reply on HN