Nov 03 21:27:04.947638 ip-10-0-142-174 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 03 21:27:04.947649 ip-10-0-142-174 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 03 21:27:04.947656 ip-10-0-142-174 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 03 21:27:04.947879 ip-10-0-142-174 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 03 21:27:15.196926 ip-10-0-142-174 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 03 21:27:15.196942 ip-10-0-142-174 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e300b380ba547baaffd9542ea273113 --
Nov 03 21:29:14.039955 ip-10-0-142-174 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 21:29:14.399360 ip-10-0-142-174 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:29:14.399360 ip-10-0-142-174 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 21:29:14.399360 ip-10-0-142-174 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:29:14.399360 ip-10-0-142-174 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:29:14.403472 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403382    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.403472 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403467    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.403472 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403472    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.403472 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403477    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403481    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403485    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403489    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403493    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403496    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403500    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403504    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403507    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403511    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403517    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403528    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403532    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403536    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403540    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403544    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403548    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403553    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403557    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.403780 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403560    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403564    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403568    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403572    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403576    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403580    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403584    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403588    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403593    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403597    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403602    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403606    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403610    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403614    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403619    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403624    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403628    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403633    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403639    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403646    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.404548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403652    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403656    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403660    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403664    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403686    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403691    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403695    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403700    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403705    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403709    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403715    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403720    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403724    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403728    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403733    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403737    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403743    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403749    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403753    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.405381 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403758    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403762    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403766    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403770    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403774    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403778    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403782    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403786    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403791    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403797    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403803    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403808    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403813    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403817    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403821    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403825    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403830    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403835    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403840    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.406251 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403844    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403849    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403853    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403857    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403862    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403867    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403871    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403875    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403879    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403884    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403888    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403894    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403898    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403904    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403907    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403912    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403916    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403920    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403925    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.407064 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403929    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403933    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403938    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403942    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403947    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403951    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.403955    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405286    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405298    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405304    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405309    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405314    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405318    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405324    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405328    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405333    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405337    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405342    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405346    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405350    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.407868 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405355    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405359    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405363    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405367    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405371    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405376    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405380    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405384    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405388    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405392    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405397    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405401    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405405    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405411    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405419    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405426    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405431    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405435    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405440    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.408598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405444    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405448    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405452    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405457    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405461    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405464    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405469    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405474    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405478    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405483    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405487    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405491    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405497    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405502    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405508    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405512    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405517    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405521    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405526    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405530    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.409082 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405536    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405540    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405544    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405549    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405553    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405558    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405562    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405566    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405571    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405575    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405579    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405583    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405587    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405591    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405595    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405599    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405604    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405608    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405612    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405616    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.409548 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405620    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405625    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405629    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405634    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405638    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405645    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405651    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405656    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405660    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405664    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405688    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405693    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405697    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405701    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405706    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405710    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405714    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405718    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405722    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.410054 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405727    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405731    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405735    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405739    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405743    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405747    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405752    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405756    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405761    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405767    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405771    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405775    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405779    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405784    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.405789    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406636    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406647    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406652    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406657    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406661    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.411008 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406666    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406687    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406691    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406695    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406700    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406704    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406709    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406713    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406718    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406722    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406726    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406731    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406735    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406739    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406744    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406748    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406752    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406756    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406761    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406765    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.411533 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406770    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406774    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406778    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406783    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406787    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406791    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406796    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406801    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406805    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406809    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406814    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406818    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406822    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406826    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406830    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406835    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406839    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406843    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406847    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.412024 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406851    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406855    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406859    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406863    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406868    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406872    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406876    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406880    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406884    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406889    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406893    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406898    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406902    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406906    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406911    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406919    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406925    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406930    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406934    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406938    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.412480 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406943    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406947    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406952    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406956    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406961    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406965    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406969    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406974    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406978    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406982    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406989    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.406995    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407000    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407004    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407009    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407013    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407017    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407021    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407025    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.413105 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407029    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407034    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407038    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407042    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407049    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407053    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407057    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407062    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407066    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407070    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407076    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407080    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407084    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407088    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407093    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407098    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407103    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407107    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407112    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407116    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.413549 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407120    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407125    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.407129    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407280    2576 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407292    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407304    2576 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407311    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407319    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407324    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407331    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407338    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407343    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407348    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407354    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407359    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407364    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407372    2576 flags.go:64] FLAG: --cgroup-root=""
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407376    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407382    2576 flags.go:64] FLAG: --client-ca-file=""
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407386    2576 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407391    2576 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407398    2576 flags.go:64] FLAG: --cluster-domain=""
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407403    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407409    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 21:29:14.414044 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407414    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407419    2576 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407426    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407432    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407437    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407442    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407447    2576 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407452    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407457    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407462    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407467    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407474    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407479    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407484    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407489    2576 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407494    2576 flags.go:64] FLAG: --enable-server="true"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407499    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407504    2576 flags.go:64] FLAG: --event-burst="100"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407509    2576 flags.go:64] FLAG: --event-qps="50"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407514    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407519    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407524    2576 flags.go:64] FLAG: --eviction-hard=""
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407530    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407535    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407542    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 21:29:14.414656 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407547    2576 flags.go:64] FLAG: --eviction-soft=""
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407552    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407556    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407561    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407566    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407571    2576 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407576    2576 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407581    2576 flags.go:64] FLAG: --feature-gates=""
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407587    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407592    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407597    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407604    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407610    2576 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407615    2576 flags.go:64] FLAG: --help="false"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407620    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407625    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407630    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407635    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407641    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407646    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407651    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407656    2576 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407660    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 21:29:14.415288 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407665    2576 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407685    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407690    2576 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407695    2576 flags.go:64] FLAG: --kube-reserved=""
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407699    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407704    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407709    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407713    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407720    2576 flags.go:64] FLAG: --lock-file=""
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407725    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407730    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407735    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407744    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407749    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407754    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407759    2576 flags.go:64] FLAG: --logging-format="text"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407764    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407769    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407774    2576 flags.go:64] FLAG: --manifest-url=""
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407780    2576 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407789    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407795    2576 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407803    2576 flags.go:64] FLAG: --max-pods="110"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407808    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407813    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 21:29:14.416049 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407818    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407823    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407828    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407832    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407837    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407850    2576 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407855    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407861    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407865    2576 flags.go:64] FLAG: --pod-cidr=""
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407870    2576 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407875    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407879    2576 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407884    2576 flags.go:64] FLAG: --port="10250"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407889    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407893    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01d22ee5fa43c0e58"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407901    2576 flags.go:64] FLAG: --qos-reserved=""
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407906    2576 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407911    2576 flags.go:64] FLAG: --register-node="true"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407916    2576 flags.go:64] FLAG: --register-with-taints=""
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407922    2576 flags.go:64] FLAG: --registry-burst="10"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407927    2576 flags.go:64] FLAG: --registry-qps="5"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407932    2576 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407936    2576 flags.go:64] FLAG: --reserved-memory=""
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407942    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407947    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407952    2576 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 21:29:14.416922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407957    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407964    2576 flags.go:64] FLAG: --runonce="false"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407969    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407975    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407980    2576 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407985    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407990    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.407995    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408000    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408005    2576 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408010    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408015    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408019    2576 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408024    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408029    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408034    2576 flags.go:64] FLAG: --system-cgroups=""
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408039    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408048    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408053    2576 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408057    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408068    2576 flags.go:64] FLAG: --tls-min-version=""
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408077    2576 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408082    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408087    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408094    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 21:29:14.417870 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408099    2576 flags.go:64] FLAG: --v="2"
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408106    2576 flags.go:64] FLAG: --version="false"
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408113    2576 flags.go:64] FLAG: --vmodule=""
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408119    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408125    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408347    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408354    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408359    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408366    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408371    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408377    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408386    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408391    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408396    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408401    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408405    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408410    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408414    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408444    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408458    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.418615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408462    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408465    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408469    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408471    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408476    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408479    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408482    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408484    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408487    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408490    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408493    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408498    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408501    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408503    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408506    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408509    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408511    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408515    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408518    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.419515 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408521    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408523    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408527    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408530    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408533    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408535    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408538    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408541    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408544    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408546    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408549    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408552    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408556    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408558    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408562    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408564    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408567    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408570    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408573    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408576    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.420362 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408578    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408581    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408584    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408587    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408590    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408593    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408595    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408598    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408601    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408603    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408606    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408610    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408613    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408616    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408618    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408621    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408624    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408626    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408629    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.420959 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408631    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408634    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408637    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408639    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408645    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408648    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408651    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408654    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408656    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408659    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408662    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408664    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408677    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408680    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408683    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408686    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408689    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408692    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408694    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408697    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.421737 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408699    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408702    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408706    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408709    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408711    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408715    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408717    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408720    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408723    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408728    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408733    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408736    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408739    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.408779    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408829    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408835    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.422565 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408839    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408844    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408847    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408849    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408852    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408855    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408857    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408860    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408863    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408866    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408868    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408871    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408874    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408876    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408879    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408882    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408884    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408887    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408890    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408893    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.423036 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408896    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.408898    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409254    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409259    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409262    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409264    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409267    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409270    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409272    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409275    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409278    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409281    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409285    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409291    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409295    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409298    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409301    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409303    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409306    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.423617 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409309    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409312    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409317    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409321    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409324    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409327    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409329    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409332    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409335    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409337    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409340    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409343    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409346    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409349    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409351    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409354    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409357    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409360    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409363    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.424136 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409365    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409368    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409371    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409373    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409376    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409378    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409381    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409385    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409387    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409390    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409392    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409395    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409397    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409400    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409403    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409406    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409408    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409411    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409414    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409416    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.424604 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409419    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409421    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409424    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409427    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409429    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409432    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409434    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409437    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409439    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409442    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409445    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409448    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409451    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409453    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409456    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409460    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409463    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409465    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409468    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.425179 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409472    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409474    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409477    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409479    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409482    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409485    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.409487    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.417788    2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.417810    2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.418406    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.418421    2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418519    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418529    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418533    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418538    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418545    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418551    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418556    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418561    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.425874 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418566    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418570    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418575    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418579    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418584    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418589    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418593    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418597    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418602    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418607    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418611    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418616    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418620    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418625    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418629    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418633    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418637    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418642    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418646    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.426691 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418650    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418654    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418659    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418663    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418683    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418688    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418692    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418697    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418701    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418705    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418709    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418713    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418718    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418722    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418726    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418730    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418735    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418739    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418744    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.427407 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418748    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418752    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418756    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418760    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418765    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418769    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418773    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418778    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418783    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418787    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418791    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418795    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418799    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418804    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418808    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418812    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418816    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418821    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418825    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418829    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.427890 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418833    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418837    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418841    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418846    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418850    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418854    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418858    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418862    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418867    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418871    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418876    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418880    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418884    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418890    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418894    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418898    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418902    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418906    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418911    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418915    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.428385 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418919    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418923    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418927    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418931    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418935    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418942    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418947    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418952    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418956    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418960    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418965    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418969    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418973    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418977    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418982    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418987    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418991    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418995    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.418999    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.429029 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419003    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.419047    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419301    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419308    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419313    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419318    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419322    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419328    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419332    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419337    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419341    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419345    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419350    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419354    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419358    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419363    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.429771 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419367    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419371    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419378    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419385    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419390    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419395    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419399    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419404    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419408    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419412    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419416    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419421    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419426    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419430    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419435    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419440    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419444    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419448    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419452    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419456    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.430213 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419461    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419465    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419469    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419473    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419479    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419483    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419488    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419491    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419495    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419500    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419504    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419508    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419512    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419518    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419524    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419529    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419533    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419537    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419541    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.430856 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419546    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419550    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419555    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419559    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419566    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419572    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419577    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419581    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419585    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419589    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419593    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419598    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419602    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419607    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419611    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419615    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419619    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419624    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419629    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419633    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.431331 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419638    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419642    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419646    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419650    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419654    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419658    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419663    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419682    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419687    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419691    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419695    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419699    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419704    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419708    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419713    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419717    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419723    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419729    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419734    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419738    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.432056 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419742    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419746    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419751    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419755    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419759    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419763    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419768    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419772    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419776    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419780    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419784    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419790    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419794    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.419839    2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419892    2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:29:14.432547 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419902    2576 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419907    2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419912    2576 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419916    2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419920    2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419925    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419929    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419933    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419937    2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419942    2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419946    2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419951    2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419955    2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419961    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419965    2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419971    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419975    2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419980    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419984    2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419988    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:29:14.432982 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419992    2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.419997    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420001    2576 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420006    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420010    2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420014    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420018    2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420022    2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420026    2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420031    2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420035    2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420040    2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420044    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420048    2576 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420052    2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420056    2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420061    2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420065    2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420070    2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420074    2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:29:14.433511 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420079    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420083    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420087    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420092    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420097    2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420102    2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420106    2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420113    2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420117    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420121    2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420125    2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420130    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420134    2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420138    2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420142    2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420146    2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420150    2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420154    2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420158    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:29:14.434200 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420163    2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420167    2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420172    2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420177    2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420181    2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420185    2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420189    2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420193    2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420197    2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420202    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420206    2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420210    2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420215    2576 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420219    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420223    2576 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420230    2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420237    2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420241    2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420248    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:29:14.434754 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420252    2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420259    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420263    2576 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420267    2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420272    2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420276    2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420280    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420285    2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420289    2576 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420293    2576 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420298    2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420302    2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420306    2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420310    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420315    2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420319    2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420323    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420328    2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420332    2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420336    2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:29:14.435226 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420340    2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420344    2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420349    2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420353    2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420357    2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420361    2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:14.420365    2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.420448    2576 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.423037    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.424072    2576 server.go:1014] "Starting client certificate rotation"
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.424171    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.424816    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.426229    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:29:14.435720 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.429589    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:29:14.440004 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.439987    2576 log.go:25] "Validated CRI v1 runtime API"
Nov 03 21:29:14.443277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.443262    2576 log.go:25] "Validated CRI v1 image API"
Nov 03 21:29:14.444135 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.444111    2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 21:29:14.446650 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.446631    2576 fs.go:135] Filesystem UUIDs: map[18e825f4-2538-4c77-a695-1b527aa83616:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d7e21e57-36f8-4389-90a7-c10c2769b51a:/dev/nvme0n1p4]
Nov 03 21:29:14.446718 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.446650    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 03 21:29:14.451664 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.451550    2576 manager.go:217] Machine: {Timestamp:2026-11-03 21:29:14.450299363 +0000 UTC m=+0.301973788 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164345344 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de430362f90afe1b5b43a5ba013d5 SystemUUID:ec2de430-362f-90af-e1b5-b43a5ba013d5 BootID:0e300b38-0ba5-47ba-affd-9542ea273113 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582172672 Type:vfs Inodes:4048382 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cf:1b:5e:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cf:1b:5e:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:68:db:78:da:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164345344 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 21:29:14.451735 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.451664    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 21:29:14.451768 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.451755    2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 21:29:14.454883 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.454859    2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 21:29:14.455010 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.454884    2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 21:29:14.455052 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.455013    2576 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 21:29:14.455052 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.455021    2576 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 21:29:14.455052 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.455046    2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:29:14.455126 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.455060    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:29:14.455834 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.455786    2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 21:29:14.459128 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459116    2576 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 21:29:14.459248 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459239    2576 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 21:29:14.459894 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459883    2576 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 21:29:14.459924 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459900    2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 21:29:14.459951 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459933    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 21:29:14.459951 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459947    2576 kubelet.go:405] "Adding apiserver pod source"
Nov 03 21:29:14.460045 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.459959    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 21:29:14.460323 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.460296    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:29:14.463597 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.463317    2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 21:29:14.467958 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.467940    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:29:14.468630 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468616    2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 21:29:14.468730 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468657    2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 21:29:14.468872 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468860    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 21:29:14.468936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468879    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 21:29:14.468936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468889    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 21:29:14.468936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468899    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 21:29:14.468936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468908    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 21:29:14.468936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.468917    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 21:29:14.469514 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.469504    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 21:29:14.469573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.469516    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 21:29:14.469573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.469527    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 21:29:14.469573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.469537    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 21:29:14.469573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.469551    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 21:29:14.469573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.469564    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 21:29:14.470107 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.470096    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 21:29:14.470158 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.470111    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 21:29:14.473843 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.473822    2576 server.go:1263] "Started kubelet"
Nov 03 21:29:14.473974 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.473944    2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 21:29:14.474021 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.473953    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 21:29:14.474021 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.474009    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 21:29:14.474530 ip-10-0-142-174 systemd[1]: Started Kubernetes Kubelet.
Nov 03 21:29:14.475834 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.475740    2576 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 21:29:14.475834 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.475762    2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 21:29:14.479868 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.479850    2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 21:29:14.479956 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.479856    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 21:29:14.480109 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.480072    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:14.480109 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.480072    2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 03 21:29:14.480454 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480434    2576 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 21:29:14.480454 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480455    2576 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 21:29:14.480623 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480610    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 21:29:14.480703 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480693    2576 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 21:29:14.480703 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480699    2576 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 21:29:14.480874 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480860    2576 factory.go:55] Registering systemd factory
Nov 03 21:29:14.480874 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.480875    2576 factory.go:223] Registration of the systemd container factory successfully
Nov 03 21:29:14.481091 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.481070    2576 factory.go:153] Registering CRI-O factory
Nov 03 21:29:14.481091 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.481091    2576 factory.go:223] Registration of the crio container factory successfully
Nov 03 21:29:14.481204 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.481143    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 21:29:14.481204 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.481164    2576 factory.go:103] Registering Raw factory
Nov 03 21:29:14.481204 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.481179    2576 manager.go:1199] Started watching for new ooms in manager
Nov 03 21:29:14.482019 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.482003    2576 manager.go:319] Starting recovery of all containers
Nov 03 21:29:14.494178 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.494155    2576 manager.go:324] Recovery completed
Nov 03 21:29:14.498957 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.498932    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 03 21:29:14.498957 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.498933    2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 03 21:29:14.499855 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.499838    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.499944 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.498924    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-174.ec2.internal.18e4a6421c56b740  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-174.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-174.ec2.internal,},FirstTimestamp:2026-11-03 21:29:14.47379744 +0000 UTC m=+0.325471866,LastTimestamp:2026-11-03 21:29:14.47379744 +0000 UTC m=+0.325471866,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-174.ec2.internal,}"
Nov 03 21:29:14.502449 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.502409    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.502511 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.502451    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.502511 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.502468    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.503040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503024    2576 cpu_manager.go:226] "Starting" policy="none"
Nov 03 21:29:14.503040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503034    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.503181 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503038    2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 21:29:14.503181 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503098    2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 21:29:14.503742 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503725    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.503812 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503755    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.503812 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.503770    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.505262 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.505248    2576 policy_none.go:50] "Start"
Nov 03 21:29:14.505327 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.505267    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 21:29:14.505327 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.505280    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 21:29:14.507215 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.507201    2576 policy_none.go:44] "Start"
Nov 03 21:29:14.518483 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.518405    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-174.ec2.internal.18e4a6421e0b9dc0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-174.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-174.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-174.ec2.internal,},FirstTimestamp:2026-11-03 21:29:14.502430144 +0000 UTC m=+0.354104571,LastTimestamp:2026-11-03 21:29:14.502430144 +0000 UTC m=+0.354104571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-174.ec2.internal,}"
Nov 03 21:29:14.518631 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.518604    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 03 21:29:14.518712 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.518624    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 03 21:29:14.518712 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.518648    2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 03 21:29:14.523186 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.523170    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 21:29:14.523257 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.523207    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d5b27"
Nov 03 21:29:14.546332 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.546301    2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 21:29:14.550859 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.550844    2576 manager.go:341] "Starting Device Plugin manager"
Nov 03 21:29:14.551304 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.551287    2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 21:29:14.551304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.551303    2576 server.go:87] "Starting device plugin registration server"
Nov 03 21:29:14.551528 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.551515    2576 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 21:29:14.551604 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.551530    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 21:29:14.552102 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.551749    2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 21:29:14.552102 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.551829    2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 21:29:14.552102 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.551837    2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 21:29:14.552302 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.552278    2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 21:29:14.552345 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.552332    2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:14.610240 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.610203    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 21:29:14.612296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.612276    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 21:29:14.612296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.612297    2576 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 21:29:14.612407 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.612316    2576 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 21:29:14.612407 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.612346    2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 03 21:29:14.625702 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.625687    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:29:14.652045 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.651999    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.652743 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.652725    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.652822 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.652754    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.652822 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.652764    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.652822 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.652794    2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.668731 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.668709    2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.668832 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.668737    2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-174.ec2.internal\": node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:14.708441 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.708419    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:14.712968 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.712951    2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"]
Nov 03 21:29:14.713023 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.713005    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.713842 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.713816    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.713924 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.713856    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.713924 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.713866    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.715891 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.715876    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.716037 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.716087 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716050    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.716582 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716565    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.716662 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716595    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.716662 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716604    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.716662 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716566    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.716839 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716687    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.716839 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.716702    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.718662 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.718647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.718757 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.718689    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:14.719341 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.719325    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:14.719341 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.719343    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:14.719472 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.719353    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:14.741909 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.741753    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-174.ec2.internal\" not found" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.744355 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.744339    2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-174.ec2.internal\" not found" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.781835 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.781809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.781916 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.781841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.781916 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.781866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4e271960909dbae93ddf03ac1216c26-config\") pod \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" (UID: \"f4e271960909dbae93ddf03ac1216c26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.808919 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.808901    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:14.882634 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.882611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.882715 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.882662    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.882762 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.882720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.882762 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.882747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4e271960909dbae93ddf03ac1216c26-config\") pod \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" (UID: \"f4e271960909dbae93ddf03ac1216c26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.882822 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.882724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.882822 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:14.882796    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4e271960909dbae93ddf03ac1216c26-config\") pod \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" (UID: \"f4e271960909dbae93ddf03ac1216c26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:14.909421 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:14.909376    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:15.010147 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:15.010114    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:15.044264 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:15.044226    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:15.047076 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:15.047057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:15.111122 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:15.111089    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:16.451375 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:16.451305    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:16.551893 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:16.551817    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:16.652339 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:16.652282    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:16.663449 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.663410    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 03 21:29:16.663558 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.663545    2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 03 21:29:16.753322 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:16.753287    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:16.770714 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.770680    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 21:24:15 +0000 UTC" deadline="2028-05-21 14:26:58.878865143 +0000 UTC"
Nov 03 21:29:16.770714 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.770710    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13552h57m42.108158202s"
Nov 03 21:29:16.840469 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:16.840431    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e271960909dbae93ddf03ac1216c26.slice/crio-c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8 WatchSource:0}: Error finding container c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8: Status 404 returned error can't find the container with id c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8
Nov 03 21:29:16.840735 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:16.840709    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22bb0111a50402150fc2be957a1cf0d.slice/crio-7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700 WatchSource:0}: Error finding container 7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700: Status 404 returned error can't find the container with id 7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700
Nov 03 21:29:16.845827 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.845812    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:29:16.853909 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:16.853886    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:16.855729 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.855691    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal" event={"ID":"f4e271960909dbae93ddf03ac1216c26","Type":"ContainerStarted","Data":"c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8"}
Nov 03 21:29:16.856670 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.856641    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" event={"ID":"a22bb0111a50402150fc2be957a1cf0d","Type":"ContainerStarted","Data":"7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700"}
Nov 03 21:29:16.874173 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.874153    2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:29:16.878719 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.878702    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:29:16.878790 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.878734    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:29:16.878790 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:16.878744    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:29:16.954967 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:16.954931    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:17.055501 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.055401    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:17.155860 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.155829    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:17.256618 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.256583    2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:29:17.283279 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.283251    2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:29:17.296108 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.296078    2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:29:17.296474 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.296455    2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:29:17.320776 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.320714    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:17.342266 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.342234    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:29:17.343386 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.343365    2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:29:17.362333 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.362306    2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:29:17.701485 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.701392    2576 apiserver.go:52] "Watching apiserver"
Nov 03 21:29:17.719951 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.719925    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 03 21:29:17.740156 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.740131    2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 21:29:17.740489 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.740466    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qwbnr","openshift-dns/node-resolver-vd6hh","openshift-multus/multus-additional-cni-plugins-wbpzb","openshift-network-operator/iptables-alerter-4p7xb","kube-system/global-pull-secret-syncer-fwwbw","kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4","openshift-ovn-kubernetes/ovnkube-node-r7hzz","openshift-image-registry/node-ca-c6h7b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal","openshift-multus/multus-p7sb7","openshift-network-diagnostics/network-check-target-qmh2m","kube-system/konnectivity-agent-hmlfq","openshift-multus/network-metrics-daemon-68p76"]
Nov 03 21:29:17.743109 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.743088    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.745221 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.745201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.747536 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.747515    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.749670 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.749649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.752327 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.752310    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:17.752394 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.752380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:17.753953 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.753931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:17.754039 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.753998    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:17.756624 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.756141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.759193 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.759177    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.761376 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.761356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.762948    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.762969    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d5mwz\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.762950    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.762991    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763017    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763024    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763057    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763084    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 21:29:17.763122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763088    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.763573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763508    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.763573 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763547    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.763765 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763743    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vzdjb\""
Nov 03 21:29:17.763765 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.763922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763815    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-6tkv6\""
Nov 03 21:29:17.763922 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.763880    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tnnmd\""
Nov 03 21:29:17.766190 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.766173    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.768723 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.768705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.768808 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.768762    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:17.769543 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.769526    2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 03 21:29:17.769629 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.769602    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7glkt"
Nov 03 21:29:17.821903 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.821882    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 21:29:17.830811 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-iptables-alerter-script\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfhdn\" (UniqueName: \"kubernetes.io/projected/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-kube-api-access-pfhdn\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-netns\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830871    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-log-socket\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snlnk\" (UniqueName: \"kubernetes.io/projected/7c7c3ddb-1837-429e-8b13-8a70a82cb841-kube-api-access-snlnk\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnzg\" (UniqueName: \"kubernetes.io/projected/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kube-api-access-lcnzg\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.830936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf5l8\" (UniqueName: \"kubernetes.io/projected/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-kube-api-access-gf5l8\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.830996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-netns\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a303b3-2834-490f-8835-b62c1f14e058-agent-certs\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-cnibin\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-var-lib-kubelet\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-k8s-cni-cncf-io\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831135    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-kubelet\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.831200 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-bin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-multus\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1435ae86-9aeb-453a-b45f-1f490d891e59-host\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fwlh\" (UniqueName: \"kubernetes.io/projected/1435ae86-9aeb-453a-b45f-1f490d891e59-kube-api-access-2fwlh\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-modprobe-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-etc-tuned\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-kubelet-config\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-cnibin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-tmp\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-script-lib\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-system-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-run\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-kubelet\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-var-lib-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-etc-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-ovn\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.831672 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-node-log\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-config\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-device-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-lib-modules\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-host\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-systemd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rskgp\" (UniqueName: \"kubernetes.io/projected/104d10b5-1122-4387-90ee-317e6cbed43f-kube-api-access-rskgp\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831786    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysconfig\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-sys\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-hostroot\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-multus-certs\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-systemd\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-socket-dir-parent\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-etc-kubernetes\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.831981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1435ae86-9aeb-453a-b45f-1f490d891e59-serviceca\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-kubernetes\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-dbus\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-daemon-config\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-conf-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/104d10b5-1122-4387-90ee-317e6cbed43f-hosts-file\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-netd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a303b3-2834-490f-8835-b62c1f14e058-konnectivity-ca\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-conf\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.832993 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-slash\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-bin\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-env-overrides\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkc7\" (UniqueName: \"kubernetes.io/projected/fedc7eb9-d1c5-4532-9bee-819c931a2358-kube-api-access-phkc7\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w9cs\" (UniqueName: \"kubernetes.io/projected/c2a214c4-5527-4293-9d24-374350f224c8-kube-api-access-9w9cs\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovn-node-metrics-cert\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-host-slash\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftxhg\" (UniqueName: \"kubernetes.io/projected/b3f294b3-83b7-4325-a70f-e784655b40e7-kube-api-access-ftxhg\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-systemd-units\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-cni-binary-copy\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/104d10b5-1122-4387-90ee-317e6cbed43f-tmp-dir\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.833732 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.832861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:17.860960 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.860935    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 21:29:17.861297 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861269    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.861400 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861310    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.861400 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861308    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 21:29:17.861593 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861569    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6tvtx\""
Nov 03 21:29:17.861593 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861581    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xgwf4\""
Nov 03 21:29:17.861853 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861838    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 21:29:17.861919 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.861884    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 21:29:17.862271 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862184    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 21:29:17.862271 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862249    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.862409 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862388    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4tzc5\""
Nov 03 21:29:17.862409 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862190    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.862534 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862518    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.862587 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862566    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w4krc\""
Nov 03 21:29:17.862587 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862574    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 21:29:17.862689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862596    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 21:29:17.862689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862609    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 21:29:17.862689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862642    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mhg7x\""
Nov 03 21:29:17.862689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862658    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.862689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862678    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 21:29:17.862853 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862695    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 21:29:17.862853 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.862707    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a303b3-2834-490f-8835-b62c1f14e058-konnectivity-ca\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-conf\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-slash\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-bin\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-env-overrides\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkc7\" (UniqueName: \"kubernetes.io/projected/fedc7eb9-d1c5-4532-9bee-819c931a2358-kube-api-access-phkc7\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934246    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w9cs\" (UniqueName: \"kubernetes.io/projected/c2a214c4-5527-4293-9d24-374350f224c8-kube-api-access-9w9cs\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovn-node-metrics-cert\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934318    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-host-slash\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftxhg\" (UniqueName: \"kubernetes.io/projected/b3f294b3-83b7-4325-a70f-e784655b40e7-kube-api-access-ftxhg\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-systemd-units\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-cni-binary-copy\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/104d10b5-1122-4387-90ee-317e6cbed43f-tmp-dir\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.938771 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934478    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-iptables-alerter-script\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhdn\" (UniqueName: \"kubernetes.io/projected/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-kube-api-access-pfhdn\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-netns\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-log-socket\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snlnk\" (UniqueName: \"kubernetes.io/projected/7c7c3ddb-1837-429e-8b13-8a70a82cb841-kube-api-access-snlnk\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnzg\" (UniqueName: \"kubernetes.io/projected/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kube-api-access-lcnzg\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf5l8\" (UniqueName: \"kubernetes.io/projected/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-kube-api-access-gf5l8\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-netns\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a303b3-2834-490f-8835-b62c1f14e058-agent-certs\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-cnibin\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-var-lib-kubelet\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-k8s-cni-cncf-io\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.939706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934870    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-kubelet\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-bin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-multus\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.934991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1435ae86-9aeb-453a-b45f-1f490d891e59-host\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fwlh\" (UniqueName: \"kubernetes.io/projected/1435ae86-9aeb-453a-b45f-1f490d891e59-kube-api-access-2fwlh\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-modprobe-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-etc-tuned\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-kubelet-config\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-cnibin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-tmp\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-script-lib\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-system-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-run\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-kubelet\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-var-lib-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-etc-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.940405 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-ovn\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-node-log\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-config\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-device-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935444    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-lib-modules\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-host\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-systemd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rskgp\" (UniqueName: \"kubernetes.io/projected/104d10b5-1122-4387-90ee-317e6cbed43f-kube-api-access-rskgp\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysconfig\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-sys\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-hostroot\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-multus-certs\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-systemd\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.941239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-socket-dir-parent\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-etc-kubernetes\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1435ae86-9aeb-453a-b45f-1f490d891e59-serviceca\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-kubernetes\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-dbus\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-daemon-config\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935932    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.935983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-conf-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.936009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/104d10b5-1122-4387-90ee-317e6cbed43f-hosts-file\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.936035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.936061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-netd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.936181    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-netd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.936778    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a303b3-2834-490f-8835-b62c1f14e058-konnectivity-ca\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937290    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937522    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-cnibin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.942075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937602    2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-sys\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937792    2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937828    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-hostroot\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937873    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-multus-certs\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-systemd\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.937969    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938086    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-socket-dir-parent\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-etc-kubernetes\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-script-lib\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938224    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938251    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-host\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938254    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-device-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938273    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-var-lib-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938286    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938312    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-systemd-units\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.938316    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938345    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-kubelet\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.943652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysconfig\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938353    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-conf-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938383    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-ovn\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/104d10b5-1122-4387-90ee-317e6cbed43f-hosts-file\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938277    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-etc-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.938408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:29:18.43838588 +0000 UTC m=+3.050309274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938417    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938454    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-system-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938462    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-bin\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-run\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938403    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-conf\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938647    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-netns\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938702    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938743    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-systemd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938794    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-node-log\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938832    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-host-slash\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.938870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-k8s-cni-cncf-io\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.944525 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-netns\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939505    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-cni-binary-copy\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/104d10b5-1122-4387-90ee-317e6cbed43f-tmp-dir\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-log-socket\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939636    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939726    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-lib-modules\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939932    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1435ae86-9aeb-453a-b45f-1f490d891e59-host\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.939965    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-kubelet\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940151    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-iptables-alerter-script\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940400    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-cnibin\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940472    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940532    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-var-lib-kubelet\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940575    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-multus\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940618    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-bin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-kubelet-config\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.940915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-modprobe-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.941353    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-daemon-config\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.945310 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.941436    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-kubernetes\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.941498    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-dbus\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.941576    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.941631    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:29:18.441616043 +0000 UTC m=+3.053539418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.942491    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-etc-tuned\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.942707    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.942803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-env-overrides\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.942834    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a303b3-2834-490f-8835-b62c1f14e058-agent-certs\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.942877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.942999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-config\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.943009    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-slash\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.943085    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1435ae86-9aeb-453a-b45f-1f490d891e59-serviceca\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.943595    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.944986    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-tmp\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.946160 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.945675    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovn-node-metrics-cert\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:17.946837 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.946689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.958343 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.958184    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:17.958343 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.958207    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:17.958343 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.958220    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:17.958343 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:17.958284    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:29:18.458265797 +0000 UTC m=+3.070189187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:17.963987 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.963950    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnzg\" (UniqueName: \"kubernetes.io/projected/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kube-api-access-lcnzg\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:17.966469 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.964435    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkc7\" (UniqueName: \"kubernetes.io/projected/fedc7eb9-d1c5-4532-9bee-819c931a2358-kube-api-access-phkc7\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:17.966469 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.964899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftxhg\" (UniqueName: \"kubernetes.io/projected/b3f294b3-83b7-4325-a70f-e784655b40e7-kube-api-access-ftxhg\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:17.967632 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.967611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rskgp\" (UniqueName: \"kubernetes.io/projected/104d10b5-1122-4387-90ee-317e6cbed43f-kube-api-access-rskgp\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:17.968244 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.968169    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhdn\" (UniqueName: \"kubernetes.io/projected/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-kube-api-access-pfhdn\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:17.968890 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.968856    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fwlh\" (UniqueName: \"kubernetes.io/projected/1435ae86-9aeb-453a-b45f-1f490d891e59-kube-api-access-2fwlh\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:17.969444 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.969390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w9cs\" (UniqueName: \"kubernetes.io/projected/c2a214c4-5527-4293-9d24-374350f224c8-kube-api-access-9w9cs\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:17.970842 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.970815    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf5l8\" (UniqueName: \"kubernetes.io/projected/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-kube-api-access-gf5l8\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:17.972055 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:17.972035    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snlnk\" (UniqueName: \"kubernetes.io/projected/7c7c3ddb-1837-429e-8b13-8a70a82cb841-kube-api-access-snlnk\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:18.057723 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.057687    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7sb7"
Nov 03 21:29:18.063228 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.063205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:29:18.069574 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.069541    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedc7eb9_d1c5_4532_9bee_819c931a2358.slice/crio-2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2 WatchSource:0}: Error finding container 2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2: Status 404 returned error can't find the container with id 2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2
Nov 03 21:29:18.074404 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.074381    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104d10b5_1122_4387_90ee_317e6cbed43f.slice/crio-d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e WatchSource:0}: Error finding container d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e: Status 404 returned error can't find the container with id d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e
Nov 03 21:29:18.087361 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.087339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:29:18.090707 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.090682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:29:18.094698 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.094677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:29:18.098615 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.098580    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a214c4_5527_4293_9d24_374350f224c8.slice/crio-6ee31bcd6614be15417fe5769b11db7825687d6e01c9c9c6f6b002892397fffc WatchSource:0}: Error finding container 6ee31bcd6614be15417fe5769b11db7825687d6e01c9c9c6f6b002892397fffc: Status 404 returned error can't find the container with id 6ee31bcd6614be15417fe5769b11db7825687d6e01c9c9c6f6b002892397fffc
Nov 03 21:29:18.108163 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.108144    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:29:18.109973 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.109944    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f294b3_83b7_4325_a70f_e784655b40e7.slice/crio-96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a WatchSource:0}: Error finding container 96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a: Status 404 returned error can't find the container with id 96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a
Nov 03 21:29:18.111289 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.111234    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcd7686_5fc7_4fc4_8b3c_cc233a14379d.slice/crio-77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361 WatchSource:0}: Error finding container 77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361: Status 404 returned error can't find the container with id 77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361
Nov 03 21:29:18.114627 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.114611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:18.116070 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.116050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:29:18.118519 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.118320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:18.119908 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.119886    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1435ae86_9aeb_453a_b45f_1f490d891e59.slice/crio-088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8 WatchSource:0}: Error finding container 088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8: Status 404 returned error can't find the container with id 088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8
Nov 03 21:29:18.125736 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.125717    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7c3ddb_1837_429e_8b13_8a70a82cb841.slice/crio-99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41 WatchSource:0}: Error finding container 99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41: Status 404 returned error can't find the container with id 99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41
Nov 03 21:29:18.131858 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.131834    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a303b3_2834_490f_8835_b62c1f14e058.slice/crio-b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904 WatchSource:0}: Error finding container b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904: Status 404 returned error can't find the container with id b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904
Nov 03 21:29:18.132595 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:29:18.132568    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c8e6ad7_2d66_46ff_89b7_14f775a7362e.slice/crio-e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d WatchSource:0}: Error finding container e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d: Status 404 returned error can't find the container with id e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d
Nov 03 21:29:18.439704 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.439680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:18.439850 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.439824    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:18.439902 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.439892    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:29:19.43987874 +0000 UTC m=+4.051802116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.540954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.541223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.541385    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.541458    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:29:19.541440847 +0000 UTC m=+4.153364295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.541835    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.541852    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.541861    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:18.541972 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:18.541896    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:29:19.541885751 +0000 UTC m=+4.153809140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:18.773336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.773212    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 21:24:17 +0000 UTC" deadline="2028-06-08 20:49:15.431554299 +0000 UTC"
Nov 03 21:29:18.773336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.773270    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13991h19m56.658287484s"
Nov 03 21:29:18.862955 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.862732    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vd6hh" event={"ID":"104d10b5-1122-4387-90ee-317e6cbed43f","Type":"ContainerStarted","Data":"d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e"}
Nov 03 21:29:18.868900 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.868869    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7sb7" event={"ID":"fedc7eb9-d1c5-4532-9bee-819c931a2358","Type":"ContainerStarted","Data":"2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2"}
Nov 03 21:29:18.878688 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.878659    2576 generic.go:356] "Generic (PLEG): container finished" podID="a22bb0111a50402150fc2be957a1cf0d" containerID="1657503f1024eaad3dcc0acf97baa106e8e7d3b1cd1e4a046635da137a0680ed" exitCode=0
Nov 03 21:29:18.878824 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.878750    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" event={"ID":"a22bb0111a50402150fc2be957a1cf0d","Type":"ContainerDied","Data":"1657503f1024eaad3dcc0acf97baa106e8e7d3b1cd1e4a046635da137a0680ed"}
Nov 03 21:29:18.906738 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.906684    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hmlfq" event={"ID":"03a303b3-2834-490f-8835-b62c1f14e058","Type":"ContainerStarted","Data":"b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904"}
Nov 03 21:29:18.928510 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.928472    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qwbnr" event={"ID":"c2a214c4-5527-4293-9d24-374350f224c8","Type":"ContainerStarted","Data":"6ee31bcd6614be15417fe5769b11db7825687d6e01c9c9c6f6b002892397fffc"}
Nov 03 21:29:18.932775 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.932741    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal" event={"ID":"f4e271960909dbae93ddf03ac1216c26","Type":"ContainerStarted","Data":"8297ca6f73c32a17fdf3dd52434a5074bfed93a2492de78b137cc2eabfa1925e"}
Nov 03 21:29:18.939354 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.939307    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4p7xb" event={"ID":"2c8e6ad7-2d66-46ff-89b7-14f775a7362e","Type":"ContainerStarted","Data":"e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d"}
Nov 03 21:29:18.944243 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.944215    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41"}
Nov 03 21:29:18.972884 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:18.972853    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6h7b" event={"ID":"1435ae86-9aeb-453a-b45f-1f490d891e59","Type":"ContainerStarted","Data":"088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8"}
Nov 03 21:29:19.006971 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.006883    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4" event={"ID":"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d","Type":"ContainerStarted","Data":"77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361"}
Nov 03 21:29:19.013758 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.013680    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerStarted","Data":"96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a"}
Nov 03 21:29:19.453010 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.452918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:19.453185 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.453100    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:19.453185 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.453172    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:29:21.453152845 +0000 UTC m=+6.065076243 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:19.554710 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.554673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:19.554868 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.554730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:19.554929 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.554892    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:19.554990 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.554950    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:29:21.554931974 +0000 UTC m=+6.166855389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:19.555112 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.555035    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:19.555112 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.555053    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:19.555112 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.555065    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:19.555112 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.555099    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:29:21.555087751 +0000 UTC m=+6.167011140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:19.773706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.773585    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 21:24:17 +0000 UTC" deadline="2028-04-07 11:17:26.73926675 +0000 UTC"
Nov 03 21:29:19.773706 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.773660    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12493h48m6.965611183s"
Nov 03 21:29:19.856906 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.856880    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:19.857066 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.857012    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:19.857133 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.857113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:19.857199 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.857182    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:19.857265 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:19.857252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:19.857339 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:19.857323    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:20.034106 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:20.034026    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" event={"ID":"a22bb0111a50402150fc2be957a1cf0d","Type":"ContainerStarted","Data":"647ae0dc0d4a43eb2c2bde5bb96222b776e63fdf0ec9239d1907401833f26a54"}
Nov 03 21:29:20.069765 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:20.069706    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal" podStartSLOduration=3.069686434 podStartE2EDuration="3.069686434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:18.96925734 +0000 UTC m=+3.581180740" watchObservedRunningTime="2026-11-03 21:29:20.069686434 +0000 UTC m=+4.681609830"
Nov 03 21:29:21.041460 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.041368    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="7f6991d280ddbbaea64cecfc709239230e6ce78fa2d0fb985162f48a9bc375a3" exitCode=0
Nov 03 21:29:21.041921 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.041547    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerDied","Data":"7f6991d280ddbbaea64cecfc709239230e6ce78fa2d0fb985162f48a9bc375a3"}
Nov 03 21:29:21.105721 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.105665    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" podStartSLOduration=4.105646245 podStartE2EDuration="4.105646245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:20.070933106 +0000 UTC m=+4.682856508" watchObservedRunningTime="2026-11-03 21:29:21.105646245 +0000 UTC m=+5.717569645"
Nov 03 21:29:21.472878 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.472792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:21.473053 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.472932    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:21.473053 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.472997    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:29:25.472980294 +0000 UTC m=+10.084903683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:21.574116 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.574075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:21.574296 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.574127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:21.574296 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.574258    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:21.574450 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.574319    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:29:25.574300694 +0000 UTC m=+10.186224077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:21.574750 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.574733    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:21.574831 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.574755    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:21.574831 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.574768    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:21.574831 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.574808    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:29:25.574794501 +0000 UTC m=+10.186717884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:21.852386 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.852353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:21.852559 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.852500    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:21.852887 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.852861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:21.852975 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.852955    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:21.853031 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:21.853011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:21.853105 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:21.853089    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:22.061061 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:22.060260    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hmlfq" event={"ID":"03a303b3-2834-490f-8835-b62c1f14e058","Type":"ContainerStarted","Data":"57a47a02a2ea7bf4ed7e3d331bd2b770634fa6eb5a19527556b3ca3e25fa4515"}
Nov 03 21:29:22.787177 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:22.787097    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:22.788175 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:22.787976    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:22.825076 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:22.824641    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hmlfq" podStartSLOduration=3.167519393 podStartE2EDuration="6.824621717s" totalImagesPullingTime="3.657102324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:22.097474547 +0000 UTC m=+6.709397946" watchObservedRunningTime="2026-11-03 21:29:22.824621717 +0000 UTC m=+7.436545117"
Nov 03 21:29:23.852982 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:23.852939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:23.853498 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:23.853078    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:23.853498 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:23.853176    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:23.853498 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:23.853262    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:23.853498 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:23.853316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:23.853498 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:23.853394    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:24.070263 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:24.070186    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c6h7b" event={"ID":"1435ae86-9aeb-453a-b45f-1f490d891e59","Type":"ContainerStarted","Data":"fc36fcd6b68a274833dc709461f2976ffc51c60cccef8121715332d866472899"}
Nov 03 21:29:24.072721 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:24.072698    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:29:24.073140 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:24.073118    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4" event={"ID":"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d","Type":"ContainerStarted","Data":"321612abfa1aaac968f7cdd470b567c5a6304806811540aa0191b1bd6cc7d847"}
Nov 03 21:29:25.333992 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.333837    2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 21:29:25.510785 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.510754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:25.510905 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.510888    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:25.510977 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.510956    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:29:33.51093569 +0000 UTC m=+18.122859085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:25.611905 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.611871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:25.612080 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.611980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:25.612145 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.612119    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:25.612145 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.612141    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:25.612244 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.612154    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:25.612244 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.612210    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:29:33.612192905 +0000 UTC m=+18.224116295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:25.612359 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.612278    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:25.612359 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.612313    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:29:33.612302081 +0000 UTC m=+18.224225459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:25.799203 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.798516    2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T21:29:25.333858318Z","UUID":"3c80f38d-61fe-4fac-b35c-92d5532643f4","Handler":null,"Name":"","Endpoint":""}
Nov 03 21:29:25.803286 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.803264    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 21:29:25.803375 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.803308    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 21:29:25.861485 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.861024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:25.861485 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.861112    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:25.861485 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.861372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:25.861485 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.861451    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:25.861832 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:25.861523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:25.861832 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:25.861648    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:26.081613 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:26.081496    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4" event={"ID":"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d","Type":"ContainerStarted","Data":"7e3980932a872c3b27c7439d5c33b21c6d195ecb8207a1f760932fd0f0125e88"}
Nov 03 21:29:26.085037 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:26.085006    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="e7023353b8a249b548e50c31c09837c57d5aa50e95927f49e2baac053846511d" exitCode=0
Nov 03 21:29:26.085166 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:26.085099    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerDied","Data":"e7023353b8a249b548e50c31c09837c57d5aa50e95927f49e2baac053846511d"}
Nov 03 21:29:26.087112 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:26.087088    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7sb7" event={"ID":"fedc7eb9-d1c5-4532-9bee-819c931a2358","Type":"ContainerStarted","Data":"57a6bf040974fe80a6c90b5df5abc6ed4a9a175d74194849c3c85b21c8cd7662"}
Nov 03 21:29:26.127323 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:26.127275    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c6h7b" podStartSLOduration=6.249898103 podStartE2EDuration="11.127262342s" totalImagesPullingTime="4.877364239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:24.107167344 +0000 UTC m=+8.719090743" watchObservedRunningTime="2026-11-03 21:29:26.127262342 +0000 UTC m=+10.739185739"
Nov 03 21:29:26.165287 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:26.164399    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-p7sb7" podStartSLOduration=3.736744986 podStartE2EDuration="11.164379579s" totalImagesPullingTime="7.427634593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:26.164027264 +0000 UTC m=+10.775950662" watchObservedRunningTime="2026-11-03 21:29:26.164379579 +0000 UTC m=+10.776302979"
Nov 03 21:29:27.092738 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.092661    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4" event={"ID":"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d","Type":"ContainerStarted","Data":"1ced352b80f91e29b39e1dfef68f616360a38c18c362e0ae55911a1344d86400"}
Nov 03 21:29:27.095205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.095174    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="9cd640ca2fdbba0cb01891e43974eafee1c813b8173413d14c2534e1e539f673" exitCode=0
Nov 03 21:29:27.095341 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.095264    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerDied","Data":"9cd640ca2fdbba0cb01891e43974eafee1c813b8173413d14c2534e1e539f673"}
Nov 03 21:29:27.097266 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.097240    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vd6hh" event={"ID":"104d10b5-1122-4387-90ee-317e6cbed43f","Type":"ContainerStarted","Data":"35d75ce0beb6535ba21a1c106bd5ea8199845b543bb6b9cca3f304c34828efeb"}
Nov 03 21:29:27.130357 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.130299    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4" podStartSLOduration=4.299293345 podStartE2EDuration="12.130281927s" totalImagesPullingTime="7.830988582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:27.130193471 +0000 UTC m=+11.742116871" watchObservedRunningTime="2026-11-03 21:29:27.130281927 +0000 UTC m=+11.742205335"
Nov 03 21:29:27.165669 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.165614    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-vd6hh" podStartSLOduration=4.114973695 podStartE2EDuration="12.165603058s" totalImagesPullingTime="8.050629363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:27.165485925 +0000 UTC m=+11.777409322" watchObservedRunningTime="2026-11-03 21:29:27.165603058 +0000 UTC m=+11.777526457"
Nov 03 21:29:27.362335 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.362255    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:27.362496 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.362404    2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:29:27.363289 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.363265    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:29:27.856191 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.856118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:27.856335 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.856195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:27.856377 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:27.856325    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:27.856663 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:27.856649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:27.856769 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:27.856750    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:27.856847 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:27.856830    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:28.100994 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:28.100930    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qwbnr" event={"ID":"c2a214c4-5527-4293-9d24-374350f224c8","Type":"ContainerStarted","Data":"b6af7aa77146a06b0706dd095c72e6ce2dde48b36c5d14bdc2b81d6219d4dec9"}
Nov 03 21:29:28.102628 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:28.102602    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4p7xb" event={"ID":"2c8e6ad7-2d66-46ff-89b7-14f775a7362e","Type":"ContainerStarted","Data":"96dd62b0d476f3be7616fba9ef1f4a9f064b4e5d8081a29b47bcf5a3ff83539f"}
Nov 03 21:29:28.104982 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:28.104951    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="e235cfbf4b6311012ff9a10d424e538eedf07bda173a7c3f22043f2eb8292b4c" exitCode=0
Nov 03 21:29:28.105063 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:28.105037    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerDied","Data":"e235cfbf4b6311012ff9a10d424e538eedf07bda173a7c3f22043f2eb8292b4c"}
Nov 03 21:29:28.138233 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:28.138190    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qwbnr" podStartSLOduration=3.264658335 podStartE2EDuration="13.138176666s" totalImagesPullingTime="9.873518331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:28.137794159 +0000 UTC m=+12.749717558" watchObservedRunningTime="2026-11-03 21:29:28.138176666 +0000 UTC m=+12.750100064"
Nov 03 21:29:28.173381 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:28.173325    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4p7xb" podStartSLOduration=4.629106064 podStartE2EDuration="12.173311183s" totalImagesPullingTime="7.544205119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:28.172608534 +0000 UTC m=+12.784531930" watchObservedRunningTime="2026-11-03 21:29:28.173311183 +0000 UTC m=+12.785234613"
Nov 03 21:29:29.855336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:29.855310    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:29.855776 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:29.855464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:29.855776 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:29.855472    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:29.855776 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:29.855473    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:29.855776 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:29.855574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:29.855776 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:29.855668    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:30.113221 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:30.112955    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="5f9b4d8ae148bc5b901efbb4e36107033310d735533bca36193807a789560a94" exitCode=0
Nov 03 21:29:30.113221 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:30.113040    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerDied","Data":"5f9b4d8ae148bc5b901efbb4e36107033310d735533bca36193807a789560a94"}
Nov 03 21:29:31.119183 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:31.119144    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="667c111891387a6950d4ca147457b0a3a1a088beaf9a04671d8fca930c297d91" exitCode=0
Nov 03 21:29:31.119607 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:31.119207    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerDied","Data":"667c111891387a6950d4ca147457b0a3a1a088beaf9a04671d8fca930c297d91"}
Nov 03 21:29:31.852690 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:31.852656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:31.852690 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:31.852680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:31.852881 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:31.852684    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:31.852881 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:31.852758    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:31.852881 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:31.852858    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:31.852978 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:31.852959    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:32.124766 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:32.124686    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" event={"ID":"b3f294b3-83b7-4325-a70f-e784655b40e7","Type":"ContainerStarted","Data":"e60a3e513c4caf5abb6c0444ec41d72ba95a3721d2ee3e800e98526fc0f89c44"}
Nov 03 21:29:32.189948 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:32.189892    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wbpzb" podStartSLOduration=6.888410626 podStartE2EDuration="17.189876952s" totalImagesPullingTime="10.301466326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:32.189295824 +0000 UTC m=+16.801219223" watchObservedRunningTime="2026-11-03 21:29:32.189876952 +0000 UTC m=+16.801800350"
Nov 03 21:29:33.129455 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.129217    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"87c78ecc2ae179c8c14608e41e0ecf4da45dc223a3be8f1f826376c5244d2367"}
Nov 03 21:29:33.129840 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.129471    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"93ca9e607abbf1c6e719e37492b76a69296f151512a87a45f0f7da668333dc2c"}
Nov 03 21:29:33.129840 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.129505    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"a4d6fdfe1da81e000f76fe7bf813bd94192a943f5693828abce1c98e05f5df0b"}
Nov 03 21:29:33.129840 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.129532    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"c6c027dc68e19c17b2152dd5a041faac8c3e82f44cd9a8c94d2db5fdbced3075"}
Nov 03 21:29:33.129840 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.129561    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"77db4a1f75f0fe1273cc8af728132a645f70ba320f8d82ea522e14f4c49dc2e1"}
Nov 03 21:29:33.129840 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.129595    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"f9285e277bdd02b5065d46dd2b94d12db54c26a46bb6d7656bac3280b6dc9541"}
Nov 03 21:29:33.569629 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.569526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:33.569766 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.569649    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:33.569766 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.569701    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:29:49.569687194 +0000 UTC m=+34.181610570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:33.670291 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.670245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:33.670291 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.670295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:33.670513 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.670387    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:33.670513 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.670402    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:33.670513 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.670438    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:33.670513 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.670449    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:33.670513 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.670453    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:29:49.670436535 +0000 UTC m=+34.282359923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:33.670513 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.670487    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:29:49.670474521 +0000 UTC m=+34.282397928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:33.853391 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.853303    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:33.853391 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.853321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:33.853603 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:33.853482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:33.853603 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.853486    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:33.853603 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.853577    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:33.853699 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:33.853638    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:35.136005 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:35.135919    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"37000f946ac97c6ce8340f4dffcd1f154eabd7e1c860cbe77e5a65419c417c3f"}
Nov 03 21:29:35.852982 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:35.852945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:35.853143 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:35.853082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:35.853143 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:35.853097    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:35.853250 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:35.853162    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:35.853250 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:35.853187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:35.853310 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:35.853273    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:37.143265 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.143227    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" event={"ID":"7c7c3ddb-1837-429e-8b13-8a70a82cb841","Type":"ContainerStarted","Data":"fb39d8d354cac06682f8f757fe4758f0571129f418f1e707cd8753426a95be6e"}
Nov 03 21:29:37.143939 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.143539    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:37.143939 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.143652    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:37.158826 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.158804    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:37.222996 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.222900    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz" podStartSLOduration=7.8351902429999996 podStartE2EDuration="22.222888208s" totalImagesPullingTime="14.387697965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:29:37.222304041 +0000 UTC m=+21.834227449" watchObservedRunningTime="2026-11-03 21:29:37.222888208 +0000 UTC m=+21.834811605"
Nov 03 21:29:37.855468 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.855435    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:37.855655 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.855437    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:37.855655 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:37.855559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:37.855655 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:37.855566    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:37.855655 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:37.855646    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:37.855840 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:37.855718    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:38.146384 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:38.146290    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:38.167722 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:38.167685    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:29:39.021788 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:39.021551    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwwbw"]
Nov 03 21:29:39.021927 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:39.021822    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:39.021927 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:39.021910    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:39.024469 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:39.024445    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-68p76"]
Nov 03 21:29:39.024574 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:39.024558    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:39.024692 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:39.024670    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:39.025005 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:39.024990    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmh2m"]
Nov 03 21:29:39.025067 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:39.025057    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:39.025152 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:39.025128    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:40.853008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:40.852953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:40.853008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:40.852985    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:40.853617 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:40.853061    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:40.853617 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:40.853071    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:40.853617 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:40.853136    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:40.853617 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:40.853217    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:42.852908 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:42.852876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:42.853485 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:42.852963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:42.853485 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:42.852972    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:42.853485 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:42.853049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:42.853485 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:42.853046    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:42.853485 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:42.853124    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:44.692604 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:44.692527    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd6hh_104d10b5-1122-4387-90ee-317e6cbed43f/dns-node-resolver/0.log"
Nov 03 21:29:44.852749 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:44.852707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:44.852951 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:44.852811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:44.852951 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:44.852911    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:44.852951 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:44.852815    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:44.852951 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:44.852817    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:44.853477 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:44.853381    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:45.235880 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:45.235851    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6h7b_1435ae86-9aeb-453a-b45f-1f490d891e59/node-ca/0.log"
Nov 03 21:29:46.852664 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:46.852625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:46.853125 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:46.852688    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:46.853125 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:46.852782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:46.853125 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:46.852779    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:46.853125 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:46.852871    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:46.853125 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:46.852970    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:48.853266 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:48.853227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:48.853708 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:48.853328    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:48.853708 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:48.853339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:48.853708 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:48.853338    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:48.853708 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:48.853408    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:48.853708 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:48.853516    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:49.576392 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:49.576358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:49.576572 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.576493    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:49.576572 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.576542    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs podName:6ced8c9c-dd43-4e53-bbf1-5a4314d2589b nodeName:}" failed. No retries permitted until 2026-11-03 21:30:21.576529354 +0000 UTC m=+66.188452743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs") pod "network-metrics-daemon-68p76" (UID: "6ced8c9c-dd43-4e53-bbf1-5a4314d2589b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 03 21:29:49.677205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:49.677165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:49.677394 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:49.677249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:49.677394 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.677306    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:49.677394 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.677363    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 03 21:29:49.677394 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.677384    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 03 21:29:49.677394 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.677396    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8xmv9 for pod openshift-network-diagnostics/network-check-target-qmh2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:49.677623 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.677368    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret podName:1f036244-f039-410c-9580-d75499fbe5c6 nodeName:}" failed. No retries permitted until 2026-11-03 21:30:21.677354016 +0000 UTC m=+66.289277408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret") pod "global-pull-secret-syncer-fwwbw" (UID: "1f036244-f039-410c-9580-d75499fbe5c6") : object "kube-system"/"original-pull-secret" not registered
Nov 03 21:29:49.677623 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:49.677475    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9 podName:7f8c1025-febc-406d-b362-6f3de07dbfaa nodeName:}" failed. No retries permitted until 2026-11-03 21:30:21.677458581 +0000 UTC m=+66.289381962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8xmv9" (UniqueName: "kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9") pod "network-check-target-qmh2m" (UID: "7f8c1025-febc-406d-b362-6f3de07dbfaa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 03 21:29:50.852534 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:50.852499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:50.852534 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:50.852506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:50.852985 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:50.852513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:50.852985 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:50.852619    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:50.852985 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:50.852667    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:50.852985 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:50.852745    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:51.199359 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:51.199275    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hmlfq_03a303b3-2834-490f-8835-b62c1f14e058/konnectivity-agent/0.log" limit=1024
Nov 03 21:29:51.446281 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:51.446249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hmlfq_03a303b3-2834-490f-8835-b62c1f14e058/konnectivity-agent/0.log" limit=1024
Nov 03 21:29:52.853242 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:52.853211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:52.853242 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:52.853238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:52.853800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:52.853244    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:52.853800 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:52.853332    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:52.853800 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:52.853388    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:52.853800 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:52.853486    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:54.852308 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:54.852269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:54.852308 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:54.852298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:54.852308 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:54.852313    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:54.852767 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:54.852392    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:54.852767 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:54.852454    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:54.852767 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:54.852533    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:56.853080 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:56.853049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:56.853500 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:56.853050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:56.853500 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:56.853149    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:56.853500 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:56.853049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:56.853500 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:56.853223    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:56.853500 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:56.853304    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:29:58.853144 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:58.853098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:29:58.853144 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:58.853145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:29:58.853681 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:29:58.853109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:29:58.853681 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:58.853223    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwwbw" podUID="1f036244-f039-410c-9580-d75499fbe5c6"
Nov 03 21:29:58.853681 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:58.853271    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qmh2m" podUID="7f8c1025-febc-406d-b362-6f3de07dbfaa"
Nov 03 21:29:58.853681 ip-10-0-142-174 kubenswrapper[2576]: E1103 21:29:58.853355    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68p76" podUID="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b"
Nov 03 21:30:00.200012 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.199936    2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeReady"
Nov 03 21:30:00.200366 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.200048    2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 03 21:30:00.251783 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.251748    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5kdw4"]
Nov 03 21:30:00.253760 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.253740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.256381 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.256348    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dm87h"]
Nov 03 21:30:00.258331 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.258314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.270201 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.270172    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 21:30:00.271096 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.271078    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9d85z"]
Nov 03 21:30:00.272674 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.272657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.273353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.273335    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qc6g7\""
Nov 03 21:30:00.273459 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.273361    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 21:30:00.274080 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.274064    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5kdw4"]
Nov 03 21:30:00.279662 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.278543    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dm87h"]
Nov 03 21:30:00.293475 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.293451    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9d85z"]
Nov 03 21:30:00.298279 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.298253    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 21:30:00.298476 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.298400    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 21:30:00.298476 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.298441    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qcvh8\""
Nov 03 21:30:00.298476 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.298465    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-fv5g9\""
Nov 03 21:30:00.352496 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cl4c\" (UniqueName: \"kubernetes.io/projected/243453a2-1472-4e79-8ff4-d2f1671f6139-kube-api-access-5cl4c\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.352661 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/243453a2-1472-4e79-8ff4-d2f1671f6139-metrics-tls\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.352661 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/904fbc27-d7c6-42c2-93fd-63170ed11ec4-data-volume\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.352661 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/243453a2-1472-4e79-8ff4-d2f1671f6139-tmp-dir\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.352775 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/243453a2-1472-4e79-8ff4-d2f1671f6139-config-volume\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.352775 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/904fbc27-d7c6-42c2-93fd-63170ed11ec4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.352775 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/904fbc27-d7c6-42c2-93fd-63170ed11ec4-crio-socket\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.352775 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.352913 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.352785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6php\" (UniqueName: \"kubernetes.io/projected/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-api-access-b6php\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.370293 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.370257    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 21:30:00.370483 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.370321    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 21:30:00.370483 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.370364    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 21:30:00.370483 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.370366    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 21:30:00.370483 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.370413    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 21:30:00.453896 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453810    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cl4c\" (UniqueName: \"kubernetes.io/projected/243453a2-1472-4e79-8ff4-d2f1671f6139-kube-api-access-5cl4c\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.453896 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/243453a2-1472-4e79-8ff4-d2f1671f6139-metrics-tls\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.453896 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/904fbc27-d7c6-42c2-93fd-63170ed11ec4-data-volume\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454144 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/243453a2-1472-4e79-8ff4-d2f1671f6139-tmp-dir\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.454144 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/243453a2-1472-4e79-8ff4-d2f1671f6139-config-volume\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.454144 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/904fbc27-d7c6-42c2-93fd-63170ed11ec4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454144 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.453996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/904fbc27-d7c6-42c2-93fd-63170ed11ec4-crio-socket\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/904fbc27-d7c6-42c2-93fd-63170ed11ec4-crio-socket\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6php\" (UniqueName: \"kubernetes.io/projected/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-api-access-b6php\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-cert\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.454336 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7vl9\" (UniqueName: \"kubernetes.io/projected/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-kube-api-access-p7vl9\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.454595 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/243453a2-1472-4e79-8ff4-d2f1671f6139-tmp-dir\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.454595 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454369    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/904fbc27-d7c6-42c2-93fd-63170ed11ec4-data-volume\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.454773 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454748    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/243453a2-1472-4e79-8ff4-d2f1671f6139-config-volume\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.454884 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.454812    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.457414 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.457390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/904fbc27-d7c6-42c2-93fd-63170ed11ec4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.457506 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.457415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/243453a2-1472-4e79-8ff4-d2f1671f6139-metrics-tls\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.471947 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.471923    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cl4c\" (UniqueName: \"kubernetes.io/projected/243453a2-1472-4e79-8ff4-d2f1671f6139-kube-api-access-5cl4c\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.472114 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.472096    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6php\" (UniqueName: \"kubernetes.io/projected/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-api-access-b6php\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.555239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.555202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-cert\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.555239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.555238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vl9\" (UniqueName: \"kubernetes.io/projected/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-kube-api-access-p7vl9\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.557582 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.557558    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-cert\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.569497 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.569473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:00.573907 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.573888    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vl9\" (UniqueName: \"kubernetes.io/projected/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-kube-api-access-p7vl9\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.575713 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.575695    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:00.583665 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.583644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:00.852584 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.852554    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:00.852737 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.852629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:00.852737 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.852729    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:00.867207 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867186    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 21:30:00.867327 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867288    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 21:30:00.867406 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867389    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2kjq7\""
Nov 03 21:30:00.867506 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867491    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxcrl\""
Nov 03 21:30:00.867552 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867519    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rf9jq\""
Nov 03 21:30:00.867592 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867547    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 21:30:00.867592 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.867556    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 21:30:00.911908 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.911825    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9d85z"]
Nov 03 21:30:00.912585 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.912557    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dm87h"]
Nov 03 21:30:00.913128 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:00.913107    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5kdw4"]
Nov 03 21:30:00.917104 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:00.917071    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243453a2_1472_4e79_8ff4_d2f1671f6139.slice/crio-081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb WatchSource:0}: Error finding container 081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb: Status 404 returned error can't find the container with id 081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb
Nov 03 21:30:00.928645 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:00.928619    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded40ebcf_733f_46d5_9967_bb6b61f58fa5.slice/crio-899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5 WatchSource:0}: Error finding container 899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5: Status 404 returned error can't find the container with id 899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5
Nov 03 21:30:00.929359 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:00.929339    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904fbc27_d7c6_42c2_93fd_63170ed11ec4.slice/crio-bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4 WatchSource:0}: Error finding container bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4: Status 404 returned error can't find the container with id bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4
Nov 03 21:30:01.119517 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.119417    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-ptcfx"]
Nov 03 21:30:01.121207 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.121183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.139843 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.139820    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-68dsn\""
Nov 03 21:30:01.140652 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.140632    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 03 21:30:01.140751 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.140736    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 03 21:30:01.145233 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.145215    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-ptcfx"]
Nov 03 21:30:01.192350 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.192305    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9d85z" event={"ID":"ed40ebcf-733f-46d5-9967-bb6b61f58fa5","Type":"ContainerStarted","Data":"899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5"}
Nov 03 21:30:01.193756 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.193730    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm87h" event={"ID":"904fbc27-d7c6-42c2-93fd-63170ed11ec4","Type":"ContainerStarted","Data":"e6a8fe883fe19384c9a52b2f7efbe12ae1395684d8f6715a1b1c472cae4b761d"}
Nov 03 21:30:01.193875 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.193776    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm87h" event={"ID":"904fbc27-d7c6-42c2-93fd-63170ed11ec4","Type":"ContainerStarted","Data":"bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4"}
Nov 03 21:30:01.194856 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.194831    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5kdw4" event={"ID":"243453a2-1472-4e79-8ff4-d2f1671f6139","Type":"ContainerStarted","Data":"081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb"}
Nov 03 21:30:01.260132 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.260094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb7pb\" (UniqueName: \"kubernetes.io/projected/4f883755-74f9-491d-97ac-98ec31061ea6-kube-api-access-rb7pb\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.260567 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.260151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f883755-74f9-491d-97ac-98ec31061ea6-tmp\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.361394 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.361356    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb7pb\" (UniqueName: \"kubernetes.io/projected/4f883755-74f9-491d-97ac-98ec31061ea6-kube-api-access-rb7pb\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.361557 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.361405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f883755-74f9-491d-97ac-98ec31061ea6-tmp\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.361716 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.361701    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f883755-74f9-491d-97ac-98ec31061ea6-tmp\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.380563 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.380486    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb7pb\" (UniqueName: \"kubernetes.io/projected/4f883755-74f9-491d-97ac-98ec31061ea6-kube-api-access-rb7pb\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.430086 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.430047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:01.747061 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:01.747028    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-ptcfx"]
Nov 03 21:30:01.756483 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:01.753132    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f883755_74f9_491d_97ac_98ec31061ea6.slice/crio-8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f WatchSource:0}: Error finding container 8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f: Status 404 returned error can't find the container with id 8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f
Nov 03 21:30:02.200539 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:02.200465    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm87h" event={"ID":"904fbc27-d7c6-42c2-93fd-63170ed11ec4","Type":"ContainerStarted","Data":"4052afc9b39479029679472618166b08d69d8e65b7af1465da54d2bcbf57a8a3"}
Nov 03 21:30:02.202946 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:02.202890    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-ptcfx" event={"ID":"4f883755-74f9-491d-97ac-98ec31061ea6","Type":"ContainerStarted","Data":"8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f"}
Nov 03 21:30:03.061286 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.061240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd6hh_104d10b5-1122-4387-90ee-317e6cbed43f/dns-node-resolver/0.log"
Nov 03 21:30:03.124773 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.124744    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"]
Nov 03 21:30:03.127964 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.127938    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.156277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.155732    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 21:30:03.156277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.155839    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 03 21:30:03.156277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.155918    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 03 21:30:03.156277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.155988    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dlfpp\""
Nov 03 21:30:03.156277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.156101    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 21:30:03.156277 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.156232    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 03 21:30:03.168689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.168602    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"]
Nov 03 21:30:03.213451 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.212497    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5kdw4" event={"ID":"243453a2-1472-4e79-8ff4-d2f1671f6139","Type":"ContainerStarted","Data":"ccbcf4abe215d0ad5b66c2daf7cd4952111052a91b733cf4417d29af66395752"}
Nov 03 21:30:03.213451 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.212562    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5kdw4" event={"ID":"243453a2-1472-4e79-8ff4-d2f1671f6139","Type":"ContainerStarted","Data":"de0e05092a2c6feb60480f454fa0847050fef6b6d0bd4fc2753f168854f934b9"}
Nov 03 21:30:03.213451 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.213315    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:03.251531 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.251469    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-5kdw4" podStartSLOduration=1.244677207 podStartE2EDuration="3.251447636s" totalImagesPullingTime="2.006770429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:03.250363691 +0000 UTC m=+47.862287096" watchObservedRunningTime="2026-11-03 21:30:03.251447636 +0000 UTC m=+47.863371044"
Nov 03 21:30:03.278677 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.278633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.278841 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.278722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76js\" (UniqueName: \"kubernetes.io/projected/4584a052-9e3d-4daf-b707-e4a584abcb74-kube-api-access-w76js\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.278841 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.278793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4584a052-9e3d-4daf-b707-e4a584abcb74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.278841 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.278830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.379891 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.379854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76js\" (UniqueName: \"kubernetes.io/projected/4584a052-9e3d-4daf-b707-e4a584abcb74-kube-api-access-w76js\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.380072 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.379970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4584a052-9e3d-4daf-b707-e4a584abcb74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.380072 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.380005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.380072 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.380061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.381217 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.381191    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4584a052-9e3d-4daf-b707-e4a584abcb74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.383727 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.383691    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.386158 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.386127    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.399972 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.399939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76js\" (UniqueName: \"kubernetes.io/projected/4584a052-9e3d-4daf-b707-e4a584abcb74-kube-api-access-w76js\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.447687 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.447658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:03.777990 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.777879    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"]
Nov 03 21:30:03.787867 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:03.787835    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4584a052_9e3d_4daf_b707_e4a584abcb74.slice/crio-69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b WatchSource:0}: Error finding container 69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b: Status 404 returned error can't find the container with id 69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b
Nov 03 21:30:03.860984 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:03.860953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6h7b_1435ae86-9aeb-453a-b45f-1f490d891e59/node-ca/0.log"
Nov 03 21:30:04.217751 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:04.217711    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9d85z" event={"ID":"ed40ebcf-733f-46d5-9967-bb6b61f58fa5","Type":"ContainerStarted","Data":"1a7db956b76b504619d49d2baa27cbaabda585ddba0d979c529f35505132d9f1"}
Nov 03 21:30:04.219097 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:04.219063    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p" event={"ID":"4584a052-9e3d-4daf-b707-e4a584abcb74","Type":"ContainerStarted","Data":"69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b"}
Nov 03 21:30:04.221665 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:04.221636    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dm87h" event={"ID":"904fbc27-d7c6-42c2-93fd-63170ed11ec4","Type":"ContainerStarted","Data":"e7179e13ffc2e78e2f3b124767abfa44ff0e92af81f927e17d97ec2bc87c4aa4"}
Nov 03 21:30:04.255101 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:04.255043    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9d85z" podStartSLOduration=1.13226903 podStartE2EDuration="4.255030942s" totalImagesPullingTime="3.122761912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:04.254624423 +0000 UTC m=+48.866547822" watchObservedRunningTime="2026-11-03 21:30:04.255030942 +0000 UTC m=+48.866954340"
Nov 03 21:30:04.295069 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:04.295005    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dm87h" podStartSLOduration=1.909601625 podStartE2EDuration="4.294984028s" totalImagesPullingTime="2.385382403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 21:30:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:04.293281085 +0000 UTC m=+48.905204482" watchObservedRunningTime="2026-11-03 21:30:04.294984028 +0000 UTC m=+48.906907427"
Nov 03 21:30:04.661875 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:04.661843    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9d85z_ed40ebcf-733f-46d5-9967-bb6b61f58fa5/serve-healthcheck-canary/0.log"
Nov 03 21:30:05.230449 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.229775    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p" event={"ID":"4584a052-9e3d-4daf-b707-e4a584abcb74","Type":"ContainerStarted","Data":"be39c2c96825c06b4ccfccd5ce73cb6aed43ccf686b2f982cb99f0db21d95c34"}
Nov 03 21:30:05.230449 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.229820    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p" event={"ID":"4584a052-9e3d-4daf-b707-e4a584abcb74","Type":"ContainerStarted","Data":"e9507cf60e438c0ad0f685b211aede171f75e88bb672a010f7202258af0e309f"}
Nov 03 21:30:05.269679 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.269627    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p" podStartSLOduration=0.9940337 podStartE2EDuration="2.269612515s" totalImagesPullingTime="1.275578815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:05.269015212 +0000 UTC m=+49.880938609" watchObservedRunningTime="2026-11-03 21:30:05.269612515 +0000 UTC m=+49.881535912"
Nov 03 21:30:05.282155 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.282117    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f6c75dc87-bjqw5"]
Nov 03 21:30:05.284143 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.284118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.300608 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.300532    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 03 21:30:05.300608 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.300558    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 03 21:30:05.300608 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.300592    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 03 21:30:05.300848 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.300643    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 03 21:30:05.300848 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.300718    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jzc78\""
Nov 03 21:30:05.300848 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.300775    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 03 21:30:05.301354 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.301331    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6c75dc87-bjqw5"]
Nov 03 21:30:05.399851 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.399817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.400027 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.399869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.400081 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.400060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.400731 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.400237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.400731 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.400338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.400731 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.400460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.400731 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.400545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501209 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501718 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501855 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.501948 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501904    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.502012 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.501982    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.502139 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.502118    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.502285 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.502267    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.503831 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.503807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.504339 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.504319    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.520345 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.520316    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.595973 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.595934    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:05.897350 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:05.896065    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6c75dc87-bjqw5"]
Nov 03 21:30:05.901325 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:05.901290    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ca70f3_0475_406c_b5ad_092bc5bf1630.slice/crio-20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87 WatchSource:0}: Error finding container 20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87: Status 404 returned error can't find the container with id 20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87
Nov 03 21:30:06.235735 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:06.235644    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6c75dc87-bjqw5" event={"ID":"33ca70f3-0475-406c-b5ad-092bc5bf1630","Type":"ContainerStarted","Data":"20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87"}
Nov 03 21:30:07.733966 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.733937    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4zmzr"]
Nov 03 21:30:07.736305 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.736278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.808173 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.808138    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 03 21:30:07.808347 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.808323    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lp7fr\""
Nov 03 21:30:07.808561 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.808543    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 03 21:30:07.808626 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.808571    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 03 21:30:07.817216 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-root\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dvk\" (UniqueName: \"kubernetes.io/projected/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-kube-api-access-j7dvk\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-sys\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-tls\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-textfile\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817552 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-metrics-client-ca\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817552 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.817552 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.817473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-wtmp\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918110 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-metrics-client-ca\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918290 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918290 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-wtmp\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918290 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-root\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918290 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dvk\" (UniqueName: \"kubernetes.io/projected/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-kube-api-access-j7dvk\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918290 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918480 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-sys\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918480 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-tls\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918480 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-textfile\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918606 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-root\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918654 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-sys\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918707 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-wtmp\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.918786 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.918745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-textfile\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.919217 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.919196    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.919322 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.919232    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-metrics-client-ca\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.921834 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.921810    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.921974 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.921955    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-tls\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:07.940475 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:07.937960    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dvk\" (UniqueName: \"kubernetes.io/projected/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-kube-api-access-j7dvk\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:08.051067 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:08.050983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:08.061622 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:08.061572    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b489156_3ebf_4f7f_b5c5_8fe4999ed900.slice/crio-c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae WatchSource:0}: Error finding container c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae: Status 404 returned error can't find the container with id c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae
Nov 03 21:30:08.243544 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:08.243509    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zmzr" event={"ID":"7b489156-3ebf-4f7f-b5c5-8fe4999ed900","Type":"ContainerStarted","Data":"c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae"}
Nov 03 21:30:09.184369 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.184338    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:09.186892 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.186869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.202015 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.201982    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 03 21:30:09.214130 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.214104    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 03 21:30:09.214130 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.214113    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 03 21:30:09.214351 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.214204    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 03 21:30:09.215599 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.215572    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 03 21:30:09.215708 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.215689    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9x4ll\""
Nov 03 21:30:09.215790 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.215774    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 03 21:30:09.215852 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.215828    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 03 21:30:09.215907 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.215896    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 03 21:30:09.216828 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.216805    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.230800 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.230553    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.239930 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.239900    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 03 21:30:09.250094 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.250065    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6c75dc87-bjqw5" event={"ID":"33ca70f3-0475-406c-b5ad-092bc5bf1630","Type":"ContainerStarted","Data":"01f933042e0cc948d9822fdc92acdf93c7f1bd0d3312cd847951ea2b234b183d"}
Nov 03 21:30:09.252862 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.252836    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zmzr" event={"ID":"7b489156-3ebf-4f7f-b5c5-8fe4999ed900","Type":"ContainerStarted","Data":"2c971f605602e768afe41497b7e566b89c6655ea912e83556327ad6c688c28ea"}
Nov 03 21:30:09.292341 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.292229    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6f6c75dc87-bjqw5" podStartSLOduration=1.180272277 podStartE2EDuration="4.29221184s" totalImagesPullingTime="3.111939563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:09.292084208 +0000 UTC m=+53.904007607" watchObservedRunningTime="2026-11-03 21:30:09.29221184 +0000 UTC m=+53.904135238"
Nov 03 21:30:09.331075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331245 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331109    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331245 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331245 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331245 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331543 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331616 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331616 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331762 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331836 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331836 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331943 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.331943 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.331866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.332414 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.332340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.334530 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.333986    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.334530 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.334314    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.334530 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.334474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.335202 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.335174    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.335648 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.335608    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.335820 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.335766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.336151 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.336131    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.336476 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.336445    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.336920 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.336901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.337137 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.337112    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.337688 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.337666    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.349759 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.349732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.507927 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.507895    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:09.838926 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.838594    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:09.863501 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:09.863472    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6f450f_e102_45b9_9806_a4fca7282d06.slice/crio-429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76 WatchSource:0}: Error finding container 429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76: Status 404 returned error can't find the container with id 429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76
Nov 03 21:30:09.893340 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.893305    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5dff68f85f-d46qq"]
Nov 03 21:30:09.904037 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.904007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.918777 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.918756    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 03 21:30:09.919021 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.918996    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 03 21:30:09.919123 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.919079    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 03 21:30:09.919175 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.919121    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 03 21:30:09.919175 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.919129    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-26q9x\""
Nov 03 21:30:09.919175 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.919130    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 03 21:30:09.919175 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.919167    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2kqbs5fqdbd96\""
Nov 03 21:30:09.920513 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.920488    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dff68f85f-d46qq"]
Nov 03 21:30:09.937349 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ddd449-8baa-4a8c-a505-ede3ef9abeea-metrics-client-ca\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937481 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937527 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937565 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-grpc-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937614 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937704 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937757 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jn45\" (UniqueName: \"kubernetes.io/projected/82ddd449-8baa-4a8c-a505-ede3ef9abeea-kube-api-access-6jn45\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937757 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ddd449-8baa-4a8c-a505-ede3ef9abeea-tmp\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:09.937757 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:09.937750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.038755 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.038915 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jn45\" (UniqueName: \"kubernetes.io/projected/82ddd449-8baa-4a8c-a505-ede3ef9abeea-kube-api-access-6jn45\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.038915 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ddd449-8baa-4a8c-a505-ede3ef9abeea-tmp\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.038915 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.038915 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ddd449-8baa-4a8c-a505-ede3ef9abeea-metrics-client-ca\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.039059 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.039059 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.038988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.039059 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.039013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-grpc-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.039059 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.039038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.039443 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.039259    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ddd449-8baa-4a8c-a505-ede3ef9abeea-tmp\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.040030 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.040004    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ddd449-8baa-4a8c-a505-ede3ef9abeea-metrics-client-ca\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.041872 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.041843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.042368 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.042339    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.042539 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.042517    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-grpc-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.043440 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.043167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.043440 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.043385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.043968 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.043945    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.057381 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.057360    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jn45\" (UniqueName: \"kubernetes.io/projected/82ddd449-8baa-4a8c-a505-ede3ef9abeea-kube-api-access-6jn45\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.161202 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.161175    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:10.222021 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.221990    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:10.257941 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.257910    2576 generic.go:356] "Generic (PLEG): container finished" podID="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" containerID="2c971f605602e768afe41497b7e566b89c6655ea912e83556327ad6c688c28ea" exitCode=0
Nov 03 21:30:10.258098 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.257996    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zmzr" event={"ID":"7b489156-3ebf-4f7f-b5c5-8fe4999ed900","Type":"ContainerDied","Data":"2c971f605602e768afe41497b7e566b89c6655ea912e83556327ad6c688c28ea"}
Nov 03 21:30:10.259757 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.259732    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76"}
Nov 03 21:30:10.537075 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:10.536986    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5dff68f85f-d46qq"]
Nov 03 21:30:10.541698 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:10.541666    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ddd449_8baa_4a8c_a505_ede3ef9abeea.slice/crio-a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb WatchSource:0}: Error finding container a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb: Status 404 returned error can't find the container with id a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb
Nov 03 21:30:11.266260 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:11.266221    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb"}
Nov 03 21:30:11.269142 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:11.269111    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zmzr" event={"ID":"7b489156-3ebf-4f7f-b5c5-8fe4999ed900","Type":"ContainerStarted","Data":"a1a4856d23eb94ae537ac516f63482a9b1518788beaec851713e753009259c1c"}
Nov 03 21:30:11.269270 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:11.269171    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4zmzr" event={"ID":"7b489156-3ebf-4f7f-b5c5-8fe4999ed900","Type":"ContainerStarted","Data":"e90935e93e1fecef264a9dc55c197f97bb16f4fb9598a0359149ff8559011b27"}
Nov 03 21:30:11.271019 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:11.270911    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c" exitCode=0
Nov 03 21:30:11.271019 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:11.270952    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c"}
Nov 03 21:30:11.311091 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:11.311025    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4zmzr" podStartSLOduration=3.202782093 podStartE2EDuration="4.311006576s" totalImagesPullingTime="1.025274934s" totalInitContainerRuntime="82.949549ms" isStatefulPod=true podCreationTimestamp="2026-11-03 21:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:11.309023653 +0000 UTC m=+55.920947054" watchObservedRunningTime="2026-11-03 21:30:11.311006576 +0000 UTC m=+55.922929975"
Nov 03 21:30:12.206821 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.205567    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-94f499b94-rbvsp"]
Nov 03 21:30:12.210938 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.210914    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.240999 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.240964    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 03 21:30:12.241159 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.241051    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 03 21:30:12.241159 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.241086    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 03 21:30:12.241264 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.241196    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-94tnq\""
Nov 03 21:30:12.247943 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.247881    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4sin7sg16ubmh\""
Nov 03 21:30:12.247943 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.247903    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 03 21:30:12.254936 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.254912    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-94f499b94-rbvsp"]
Nov 03 21:30:12.260396 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-client-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.260530 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-client-certs\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.260583 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.260631 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctjfh\" (UniqueName: \"kubernetes.io/projected/fee08312-111b-48d2-923b-b5b5ea20260c-kube-api-access-ctjfh\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.260674 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-tls\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.260674 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fee08312-111b-48d2-923b-b5b5ea20260c-audit-log\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.260766 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.260687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-metrics-server-audit-profiles\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.361965 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.361928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fee08312-111b-48d2-923b-b5b5ea20260c-audit-log\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.361978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-metrics-server-audit-profiles\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.362038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-client-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.362175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-client-certs\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.362236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.362267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctjfh\" (UniqueName: \"kubernetes.io/projected/fee08312-111b-48d2-923b-b5b5ea20260c-kube-api-access-ctjfh\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.362296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-tls\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.362399 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.362363    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fee08312-111b-48d2-923b-b5b5ea20260c-audit-log\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.363693 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.363671    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-metrics-server-audit-profiles\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.365041 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.365016    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.365613 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.365566    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-tls\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.366109 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.366088    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-client-certs\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.366618 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.366596    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-client-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.384390 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.384364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctjfh\" (UniqueName: \"kubernetes.io/projected/fee08312-111b-48d2-923b-b5b5ea20260c-kube-api-access-ctjfh\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.525933 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.525853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:12.848733 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:12.848692    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-94f499b94-rbvsp"]
Nov 03 21:30:12.853842 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:12.853804    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee08312_111b_48d2_923b_b5b5ea20260c.slice/crio-d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed WatchSource:0}: Error finding container d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed: Status 404 returned error can't find the container with id d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed
Nov 03 21:30:13.285881 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:13.285851    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"a2026361443a76757bfbeb62a998234222c50765837e615f323cfdfa8a8f0b62"}
Nov 03 21:30:13.286006 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:13.285931    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"75b3c5913e7b69e4601228401aa60819cac200963df921063aa7d7c50a4b8b04"}
Nov 03 21:30:13.286006 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:13.285981    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"c58cdfcb19f7e7aedd352528635620f4d6de4c6431ba959bda0ca8c2c1195f92"}
Nov 03 21:30:13.287274 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:13.287226    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-94f499b94-rbvsp" event={"ID":"fee08312-111b-48d2-923b-b5b5ea20260c","Type":"ContainerStarted","Data":"d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed"}
Nov 03 21:30:13.289376 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:13.289354    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9"}
Nov 03 21:30:14.233542 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.233266    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:14.303906 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.303819    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737"}
Nov 03 21:30:14.303906 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.303877    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11"}
Nov 03 21:30:14.303906 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.303906    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0"}
Nov 03 21:30:14.304140 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.303930    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29"}
Nov 03 21:30:14.304140 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.303954    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerStarted","Data":"983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e"}
Nov 03 21:30:14.307783 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.307695    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"001da5cef9036b4cefd9336c4b91358f9408fe036f4c9710f0531ba82b4331ad"}
Nov 03 21:30:14.353063 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.352964    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.636876053 podStartE2EDuration="5.352949534s" totalImagesPullingTime="3.697798719s" totalInitContainerRuntime="18.274762ms" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:14.352626641 +0000 UTC m=+58.964550040" watchObservedRunningTime="2026-11-03 21:30:14.352949534 +0000 UTC m=+58.964872931"
Nov 03 21:30:14.701881 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.701800    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:14.706395 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.706368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.722205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.722179    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 03 21:30:14.722836 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.722813    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 03 21:30:14.722959 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.722945    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 03 21:30:14.723239 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723222    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 03 21:30:14.723294 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723282    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 03 21:30:14.723375 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723363    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dunbs395f4ba0\""
Nov 03 21:30:14.723449 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723436    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 03 21:30:14.723488 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723479    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 03 21:30:14.723578 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723562    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 03 21:30:14.723695 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723682    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 03 21:30:14.723769 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723755    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 03 21:30:14.723855 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723842    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 03 21:30:14.723902 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.723889    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 03 21:30:14.745768 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.745736    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x9smh\""
Nov 03 21:30:14.747974 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.747947    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:14.748687 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.748508    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 03 21:30:14.748780 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.748701    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 03 21:30:14.783516 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783675 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783675 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783675 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783852 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783852 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783852 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.783852 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.783994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784040 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.784304 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.784237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885026 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.884987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885034    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885205 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.885577 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.886329 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.886329 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.885799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.886852 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.886822    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887176 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887037    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887516 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887608 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887718 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887793 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887905 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.887984 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.888034 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.887996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.888118 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.888101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.888263 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.888248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.888847 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.888819    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.889199 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.889154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.890453 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.890153    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.891253 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.886065    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.892183 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.892143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.893854 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.892622    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.893854 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.893264    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.896781 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.895927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.897408 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.897027    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.897408 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.897255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.897408 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.897378    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.897640 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.897615    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.897788 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.897728    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.898290 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.898248    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.899206 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.899129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.899524 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.899502    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.899942 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.899917    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:14.906114 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:14.906093    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:15.040483 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.040380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:15.315475 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.315379    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"ca78eef4ca4b1ebb9fc9a1f8fd050ddc7c723d4043a020f1d42100ca05ff033d"}
Nov 03 21:30:15.315896 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.315502    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" event={"ID":"82ddd449-8baa-4a8c-a505-ede3ef9abeea","Type":"ContainerStarted","Data":"768c86e1ab1f8718e4899598f26e81cd46315fdf170e462d621ce761faa3221c"}
Nov 03 21:30:15.315896 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.315691    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:15.317507 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.317474    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-94f499b94-rbvsp" event={"ID":"fee08312-111b-48d2-923b-b5b5ea20260c","Type":"ContainerStarted","Data":"db3485d86001a6f5d64020f693afdb43e70917cf302df0a4ee787e6b701537b8"}
Nov 03 21:30:15.359942 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.359885    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq" podStartSLOduration=2.9909649050000002 podStartE2EDuration="6.359865714s" totalImagesPullingTime="3.368900809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:15.3584648 +0000 UTC m=+59.970388199" watchObservedRunningTime="2026-11-03 21:30:15.359865714 +0000 UTC m=+59.971789114"
Nov 03 21:30:15.386566 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:15.386535    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e56c252_c9ea_4722_86a0_8d02dadabb64.slice/crio-574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944 WatchSource:0}: Error finding container 574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944: Status 404 returned error can't find the container with id 574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944
Nov 03 21:30:15.388381 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.388358    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:15.397440 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.397391    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-94f499b94-rbvsp" podStartSLOduration=1.7208348610000002 podStartE2EDuration="3.397379329s" totalImagesPullingTime="1.676544468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:15.397092623 +0000 UTC m=+60.009016022" watchObservedRunningTime="2026-11-03 21:30:15.397379329 +0000 UTC m=+60.009302727"
Nov 03 21:30:15.596122 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.596092    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:15.596312 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.596159    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:15.602885 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:15.602760    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:16.323190 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:16.323149    2576 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e" exitCode=0
Nov 03 21:30:16.323641 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:16.323242    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"}
Nov 03 21:30:16.323641 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:16.323314    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944"}
Nov 03 21:30:16.327894 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:16.327871    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:18.644633 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.644600    2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-8468c44d4b-br6gz"]
Nov 03 21:30:18.648501 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.648475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.707829 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.704786    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468c44d4b-br6gz"]
Nov 03 21:30:18.709179 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.709149    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 03 21:30:18.728753 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.728720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.728894 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.728763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.728894 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.728794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.728977 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.728890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.729007 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.728994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.729110 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.729084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.729272 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.729252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.729361 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.729293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.830788 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.830788 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.831008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.831008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.831008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830936    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.831008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.831008 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.830989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.831255 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.831024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.832041 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.831650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.832041 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.831976    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.832041 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.831995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.832257 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.832083    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.832532 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.832501    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.834510 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.834484    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.839032 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.838986    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.851043 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.851016    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:18.963651 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:18.963571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:19.282151 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:19.282073    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8468c44d4b-br6gz"]
Nov 03 21:30:19.288623 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:19.288565    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaac9c70_597d_4101_b1eb_aba133d57c37.slice/crio-e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355 WatchSource:0}: Error finding container e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355: Status 404 returned error can't find the container with id e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355
Nov 03 21:30:19.337353 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:19.337318    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c44d4b-br6gz" event={"ID":"baac9c70-597d-4101-b1eb-aba133d57c37","Type":"ContainerStarted","Data":"e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355"}
Nov 03 21:30:20.353235 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:20.352631    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c44d4b-br6gz" event={"ID":"baac9c70-597d-4101-b1eb-aba133d57c37","Type":"ContainerStarted","Data":"2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694"}
Nov 03 21:30:20.358799 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:20.358772    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"}
Nov 03 21:30:20.358902 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:20.358849    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"}
Nov 03 21:30:20.358902 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:20.358892    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"}
Nov 03 21:30:20.359030 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:20.358930    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"}
Nov 03 21:30:20.395575 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:20.395528    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-8468c44d4b-br6gz" podStartSLOduration=2.395512282 podStartE2EDuration="2.395512282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:20.393366815 +0000 UTC m=+65.005290214" watchObservedRunningTime="2026-11-03 21:30:20.395512282 +0000 UTC m=+65.007435679"
Nov 03 21:30:21.332708 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.332600    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:21.365383 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.365345    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-ptcfx" event={"ID":"4f883755-74f9-491d-97ac-98ec31061ea6","Type":"ContainerStarted","Data":"ddf5815e8178933fc7c02d2ca39c0145757d2bae2ab07c9fe788b6331c86db15"}
Nov 03 21:30:21.366235 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.365553    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:21.372887 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.372854    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"}
Nov 03 21:30:21.373006 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.372927    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerStarted","Data":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"}
Nov 03 21:30:21.380466 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.380443    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:21.420975 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.420643    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-ptcfx" podStartSLOduration=1.288119589 podStartE2EDuration="20.420625274s" totalImagesPullingTime="19.132505685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:21.420045087 +0000 UTC m=+66.031968486" watchObservedRunningTime="2026-11-03 21:30:21.420625274 +0000 UTC m=+66.032548676"
Nov 03 21:30:21.477224 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.476766    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.883539134 podStartE2EDuration="7.476750982s" totalImagesPullingTime="3.564667073s" totalInitContainerRuntime="28.544775ms" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:21.474040163 +0000 UTC m=+66.085963562" watchObservedRunningTime="2026-11-03 21:30:21.476750982 +0000 UTC m=+66.088674379"
Nov 03 21:30:21.665567 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.665524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:21.679269 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.679238    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 21:30:21.691180 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.691137    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:21.766735 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.766695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:21.766932 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.766773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:21.780689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.780572    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 21:30:21.780689 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.780661    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 21:30:21.789698 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.789666    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:21.801330 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.801297    2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 21:30:21.810577 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.810551    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:21.876999 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.876967    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2kjq7\""
Nov 03 21:30:21.882637 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.882608    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rf9jq\""
Nov 03 21:30:21.884877 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.884658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:21.889016 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.888980    2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxcrl\""
Nov 03 21:30:21.889593 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.889579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:21.895968 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:21.895949    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:22.245158 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:22.244914    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qmh2m"]
Nov 03 21:30:22.263483 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:22.261093    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwwbw"]
Nov 03 21:30:22.290937 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:22.290862    2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-68p76"]
Nov 03 21:30:22.298598 ip-10-0-142-174 kubenswrapper[2576]: W1103 21:30:22.298568    2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ced8c9c_dd43_4e53_bbf1_5a4314d2589b.slice/crio-df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc WatchSource:0}: Error finding container df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc: Status 404 returned error can't find the container with id df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc
Nov 03 21:30:22.377537 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:22.377459    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-68p76" event={"ID":"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b","Type":"ContainerStarted","Data":"df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc"}
Nov 03 21:30:22.379208 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:22.379152    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwwbw" event={"ID":"1f036244-f039-410c-9580-d75499fbe5c6","Type":"ContainerStarted","Data":"b46aaebb98e7e5b28a534d11d95f096981ad719fe249a2b0f0c076a57c8c85ef"}
Nov 03 21:30:22.380851 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:22.380823    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmh2m" event={"ID":"7f8c1025-febc-406d-b362-6f3de07dbfaa","Type":"ContainerStarted","Data":"604d0a97c78d6043b873d3448b2aba75c4a573d1ecabd840359c1b38bf9dfd96"}
Nov 03 21:30:25.041409 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:25.041373    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:25.439523 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:25.439386    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-68p76" event={"ID":"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b","Type":"ContainerStarted","Data":"615cec42590e8febafae1ee30a84592370c0334365c15a93e329e8afaa17b3ba"}
Nov 03 21:30:26.448546 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:26.447792    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-68p76" event={"ID":"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b","Type":"ContainerStarted","Data":"be479ef62ef5ad23dfdd5694f351bd17aa290ef7aa727c58c368fbad082e8a77"}
Nov 03 21:30:26.485666 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:26.485594    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-68p76" podStartSLOduration=68.527209361 podStartE2EDuration="1m11.485574477s" totalImagesPullingTime="2.958365116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:26.485451387 +0000 UTC m=+71.097374785" watchObservedRunningTime="2026-11-03 21:30:26.485574477 +0000 UTC m=+71.097497879"
Nov 03 21:30:28.460866 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:28.460764    2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qmh2m" event={"ID":"7f8c1025-febc-406d-b362-6f3de07dbfaa","Type":"ContainerStarted","Data":"2fb8547fc5570e29b4220c70f2c424e48501917d70f53280873e55e68856c778"}
Nov 03 21:30:28.964093 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:28.964051    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:28.964283 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:28.964129    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:28.969464 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:28.969438    2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:29.468133 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:29.468105    2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:29.502598 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:29.502551    2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qmh2m" podStartSLOduration=68.42253437 podStartE2EDuration="1m14.502537684s" totalImagesPullingTime="6.080003314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:29.501156696 +0000 UTC m=+74.113080093" watchObservedRunningTime="2026-11-03 21:30:29.502537684 +0000 UTC m=+74.114461082"
Nov 03 21:30:29.566218 ip-10-0-142-174 kubenswrapper[2576]: I1103 21:30:29.566181    2576 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6c75dc87-bjqw5"]
Nov 03 21:30:29.945120 ip-10-0-142-174 systemd[1]: Stopping Kubernetes Kubelet...
Nov 03 21:30:29.966032 ip-10-0-142-174 systemd[1]: kubelet.service: Deactivated successfully.
Nov 03 21:30:29.966290 ip-10-0-142-174 systemd[1]: Stopped Kubernetes Kubelet.
Nov 03 21:30:29.966360 ip-10-0-142-174 systemd[1]: kubelet.service: Consumed 4.683s CPU time.
Nov 03 21:30:29.982333 ip-10-0-142-174 systemd[1]: Starting Kubernetes Kubelet...
Nov 03 21:30:30.070551 ip-10-0-142-174 kubenswrapper[6774]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:30:30.070551 ip-10-0-142-174 kubenswrapper[6774]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 03 21:30:30.070551 ip-10-0-142-174 kubenswrapper[6774]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:30:30.070551 ip-10-0-142-174 kubenswrapper[6774]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 03 21:30:30.072800 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072710    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.072800 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072796    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.072800 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072802    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.072800 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072806    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072811    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072815    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072819    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072830    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072834    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072837    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072841    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072845    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072850    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072855    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072858    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072862    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072866    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072870    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072874    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072878    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072882    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072889    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.073074 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072896    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072902    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072906    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072910    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072914    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072918    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072924    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072930    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072935    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072940    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072945    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072951    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072955    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072960    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072965    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072970    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072974    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072980    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072985    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.073962 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072989    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072994    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.072999    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073004    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073008    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073012    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073017    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073021    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073025    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073030    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073034    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073038    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073044    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073068    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073073    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073077    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073081    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073086    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073090    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.074839 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073095    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073099    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073103    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073108    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073112    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073116    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073121    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073125    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073130    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073134    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073138    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073142    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073148    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073153    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073158    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073163    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073167    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073171    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073176    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073180    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.075722 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073184    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073188    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073193    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073197    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073201    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073207    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073213    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073218    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073223    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073227    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073231    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073236    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073240    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073245    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073249    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073255    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073259    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073264    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073268    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073272    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.076678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073277    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073281    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073285    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073290    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073294    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.073299    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074555    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074566    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074571    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074575    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074580    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074584    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074588    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074592    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074597    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074601    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074606    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074612    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074619    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.077625 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074624    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074629    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074633    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074638    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074642    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074646    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074651    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074655    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074659    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074664    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074668    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074673    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074677    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074681    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074686    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074690    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074694    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074698    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074702    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.078607 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074707    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074712    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074716    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074721    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074725    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074729    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074733    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074738    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074742    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074746    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074750    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074755    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074763    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074767    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074772    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074776    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074780    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074785    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074789    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074793    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.079594 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074798    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074802    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074806    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074811    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074815    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074819    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074824    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074828    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074832    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074837    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074841    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074845    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074851    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074858    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074863    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074868    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074873    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074878    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074882    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074886    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.080114 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074891    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074895    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074899    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074905    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074911    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074916    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074920    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074925    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074931    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074938    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074942    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074947    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074951    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074955    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074959    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074964    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074969    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074973    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074977    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.080678 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074981    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074986    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074990    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074994    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.074998    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075003    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075009    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075019    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075024    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075028    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075032    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075037    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075043    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075047    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075051    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075901    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075911    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075919    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075923    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075928    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.081219 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075932    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075936    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075941    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075945    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075950    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075954    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075959    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075963    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075968    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075972    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075976    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075980    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075984    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075989    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075993    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.075997    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076001    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076012    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076016    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076022    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.081756 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076026    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076030    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076034    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076040    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076046    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076051    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076056    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076061    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076065    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076071    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076076    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076080    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076084    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076088    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076093    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076098    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076102    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076106    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076111    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.082254 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076115    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076119    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076124    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076128    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076132    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076136    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076141    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076145    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076149    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076153    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076159    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076164    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076168    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076172    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076179    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076184    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076189    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076194    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076199    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076203    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.082751 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076207    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076212    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076219    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076223    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076228    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076232    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076236    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076240    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076245    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076250    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076254    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076259    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076263    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076268    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076272    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076276    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076281    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076285    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076289    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.083249 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076293    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076298    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076302    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076308    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076312    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076317    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076321    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076326    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076330    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076334    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076339    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076343    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076347    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076351    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076355    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076362    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076366    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076370    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076375    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.083930 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076381    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076385    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076389    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.076394    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076545    6774 flags.go:64] FLAG: --address="0.0.0.0"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076563    6774 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076576    6774 flags.go:64] FLAG: --anonymous-auth="true"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076582    6774 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076590    6774 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076595    6774 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076603    6774 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076610    6774 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076615    6774 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076621    6774 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076626    6774 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076631    6774 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076639    6774 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076644    6774 flags.go:64] FLAG: --cgroup-root=""
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076649    6774 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076654    6774 flags.go:64] FLAG: --client-ca-file=""
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076659    6774 flags.go:64] FLAG: --cloud-provider="external"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076665    6774 flags.go:64] FLAG: --cluster-dns="[]"
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076671    6774 flags.go:64] FLAG: --cluster-domain=""
Nov 03 21:30:30.084707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076676    6774 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076681    6774 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076685    6774 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076691    6774 flags.go:64] FLAG: --container-log-max-files="5"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076697    6774 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076704    6774 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076709    6774 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076714    6774 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076719    6774 flags.go:64] FLAG: --contention-profiling="false"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076724    6774 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076729    6774 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076734    6774 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076739    6774 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076745    6774 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076750    6774 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076756    6774 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076760    6774 flags.go:64] FLAG: --enable-load-reader="false"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076766    6774 flags.go:64] FLAG: --enable-server="true"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076771    6774 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076777    6774 flags.go:64] FLAG: --event-burst="100"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076783    6774 flags.go:64] FLAG: --event-qps="50"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076787    6774 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076792    6774 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076797    6774 flags.go:64] FLAG: --eviction-hard=""
Nov 03 21:30:30.085292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076804    6774 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076809    6774 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076814    6774 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076819    6774 flags.go:64] FLAG: --eviction-soft=""
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076824    6774 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076829    6774 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076834    6774 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076839    6774 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076844    6774 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076850    6774 flags.go:64] FLAG: --fail-swap-on="true"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076855    6774 flags.go:64] FLAG: --feature-gates=""
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076862    6774 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076866    6774 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076873    6774 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076879    6774 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076884    6774 flags.go:64] FLAG: --healthz-port="10248"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076889    6774 flags.go:64] FLAG: --help="false"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076894    6774 flags.go:64] FLAG: --hostname-override="ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076899    6774 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076904    6774 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076909    6774 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076915    6774 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076921    6774 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076926    6774 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 03 21:30:30.086049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076930    6774 flags.go:64] FLAG: --image-service-endpoint=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076935    6774 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076940    6774 flags.go:64] FLAG: --kube-api-burst="100"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076945    6774 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076950    6774 flags.go:64] FLAG: --kube-api-qps="50"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076955    6774 flags.go:64] FLAG: --kube-reserved=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076959    6774 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076964    6774 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076969    6774 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076973    6774 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076979    6774 flags.go:64] FLAG: --lock-file=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076984    6774 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076989    6774 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.076994    6774 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077008    6774 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077013    6774 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077019    6774 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077024    6774 flags.go:64] FLAG: --logging-format="text"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077029    6774 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077035    6774 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077040    6774 flags.go:64] FLAG: --manifest-url=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077046    6774 flags.go:64] FLAG: --manifest-url-header=""
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077053    6774 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077058    6774 flags.go:64] FLAG: --max-open-files="1000000"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077064    6774 flags.go:64] FLAG: --max-pods="110"
Nov 03 21:30:30.086659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077070    6774 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077075    6774 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077080    6774 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077085    6774 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077090    6774 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077094    6774 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077099    6774 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077110    6774 flags.go:64] FLAG: --node-status-max-images="50"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077116    6774 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077121    6774 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077126    6774 flags.go:64] FLAG: --pod-cidr=""
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077130    6774 flags.go:64] FLAG: --pod-manifest-path=""
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077135    6774 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077140    6774 flags.go:64] FLAG: --pods-per-core="0"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077144    6774 flags.go:64] FLAG: --port="10250"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077149    6774 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077154    6774 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01d22ee5fa43c0e58"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077159    6774 flags.go:64] FLAG: --qos-reserved=""
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077164    6774 flags.go:64] FLAG: --read-only-port="10255"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077169    6774 flags.go:64] FLAG: --register-node="true"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077175    6774 flags.go:64] FLAG: --register-with-taints=""
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077181    6774 flags.go:64] FLAG: --registry-burst="10"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077185    6774 flags.go:64] FLAG: --registry-qps="5"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077190    6774 flags.go:64] FLAG: --reserved-cpus=""
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077195    6774 flags.go:64] FLAG: --reserved-memory=""
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077202    6774 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 03 21:30:30.087284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077207    6774 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077212    6774 flags.go:64] FLAG: --rotate-certificates="false"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077219    6774 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077224    6774 flags.go:64] FLAG: --runonce="false"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077229    6774 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077234    6774 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077239    6774 flags.go:64] FLAG: --seccomp-default="false"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077243    6774 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077248    6774 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077254    6774 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077259    6774 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077264    6774 flags.go:64] FLAG: --storage-driver-password="root"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077269    6774 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077273    6774 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077278    6774 flags.go:64] FLAG: --storage-driver-user="root"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077282    6774 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077287    6774 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077293    6774 flags.go:64] FLAG: --system-cgroups=""
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077297    6774 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077306    6774 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077311    6774 flags.go:64] FLAG: --tls-cert-file=""
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077316    6774 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077323    6774 flags.go:64] FLAG: --tls-min-version=""
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077327    6774 flags.go:64] FLAG: --tls-private-key-file=""
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077332    6774 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 03 21:30:30.087949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077337    6774 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077344    6774 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077349    6774 flags.go:64] FLAG: --v="2"
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077356    6774 flags.go:64] FLAG: --version="false"
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077363    6774 flags.go:64] FLAG: --vmodule=""
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077369    6774 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.077375    6774 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077622    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077632    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077651    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077656    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077661    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077665    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077670    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077674    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077679    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077684    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077688    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077693    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077698    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077704    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.088773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077711    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077715    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077720    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077724    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077729    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077733    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077737    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077741    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077746    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077750    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077755    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077760    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077766    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077771    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077776    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077780    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077785    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077789    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077794    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.089453 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077799    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077804    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077808    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077813    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077817    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077822    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077826    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077830    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077834    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077838    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077843    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077847    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077851    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077855    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077859    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077864    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077868    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077873    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077878    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077882    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.090148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077886    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077890    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077894    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077898    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077902    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077910    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077914    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077918    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077923    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077927    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077931    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077936    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077945    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077950    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077954    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077959    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077963    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077968    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077972    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.090668 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077977    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077981    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077985    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077989    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077994    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.077998    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078002    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078007    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078011    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078015    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078022    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078028    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078032    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078037    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078041    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078045    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078050    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078055    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078060    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078065    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.091147 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078069    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078074    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078078    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078082    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078087    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078091    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078097    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078101    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078105    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078109    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078114    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078118    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078123    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078127    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.078169    6774 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078224    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.091717 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078232    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078237    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078242    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078247    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078251    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078269    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078274    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078278    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078283    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078287    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078291    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078295    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078299    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078304    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078315    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078320    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078324    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078329    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078333    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078338    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.092130 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078342    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078347    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078351    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078356    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078361    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078365    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078370    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078374    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078378    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078382    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078387    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078391    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078397    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078404    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078409    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078414    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078432    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078437    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078442    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078446    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.092773 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078452    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078456    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078460    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078464    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078469    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078473    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078480    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078484    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078488    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078493    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078497    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078502    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078506    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078510    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078514    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078519    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078524    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078529    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078533    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078538    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.093271 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078542    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078546    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078551    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078555    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078559    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078564    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078570    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078575    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078579    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078585    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078591    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078596    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078602    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078606    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078610    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078614    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078619    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078623    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078629    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.093803 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078633    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078638    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078643    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078647    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078652    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078656    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078660    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078665    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078669    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078673    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078678    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078685    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078689    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078694    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078698    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078702    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078707    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078711    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078715    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.094272 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078720    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078724    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078728    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078733    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078737    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078741    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.078748    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.082914    6774 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.082931    6774 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.082950    6774 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.082956    6774 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083012    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083018    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083021    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083026    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083030    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083034    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083037    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083040    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.094766 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083042    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083045    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083048    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083051    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083053    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083056    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083059    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083062    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083064    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083067    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083070    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083072    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083075    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083078    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083081    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083083    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083086    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083089    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083091    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083094    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.095299 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083097    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083106    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083109    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083112    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083115    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083118    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083120    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083123    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083125    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083128    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083131    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083133    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083136    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083138    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083141    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083144    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083146    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083149    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083151    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083154    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.095882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083156    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083159    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083162    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083164    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083167    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083169    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083172    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083174    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083177    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083180    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083183    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083185    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083188    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083191    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083201    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083205    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083209    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083212    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083215    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083218    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.096371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083220    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083223    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083225    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083228    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083230    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083233    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083236    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083238    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083241    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083244    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083246    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083249    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083252    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083254    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083257    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083260    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083262    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083265    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083268    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.096882 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083271    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083274    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083276    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083279    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083281    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083284    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083287    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083289    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083300    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083303    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083305    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083308    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083310    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083313    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083315    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083318    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083321    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083323    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.097345 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.083326    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.083353    6774 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084090    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084110    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084115    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084127    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084133    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084138    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084142    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084149    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084153    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084160    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084164    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084171    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084175    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.097808 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084179    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084184    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084189    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084199    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084204    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084208    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084213    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084217    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084247    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084251    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084256    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084260    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084264    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084268    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084273    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084282    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084286    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084290    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084295    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084299    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.098213 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084304    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084308    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084312    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084316    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084320    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084325    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084328    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084333    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084342    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084346    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084350    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084354    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084358    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084363    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084367    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084371    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084375    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084380    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084383    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084388    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.098730 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084392    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084442    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084447    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084452    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084456    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084460    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084465    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084470    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084474    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084478    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084483    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084488    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084492    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084501    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084506    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084510    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084515    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084519    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084527    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084532    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.099264 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084536    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084540    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084544    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084548    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084552    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084557    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084566    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084570    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084576    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084583    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084588    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084594    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084599    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084604    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084644    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084649    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084653    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084657    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084665    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.099802 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084671    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084675    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084681    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084687    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084691    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084696    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084700    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084705    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084711    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084715    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084720    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084727    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084737    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084858    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.084910    6774 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 03 21:30:30.100372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084972    6774 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084978    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084982    6774 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084986    6774 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084989    6774 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084992    6774 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084995    6774 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.084998    6774 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085001    6774 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085003    6774 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085006    6774 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085009    6774 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085012    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085015    6774 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085018    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085021    6774 feature_gate.go:386] unrecognized feature gate: Example2
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085024    6774 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085026    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085029    6774 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085032    6774 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 03 21:30:30.101005 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085035    6774 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085038    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085040    6774 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085043    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085046    6774 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085049    6774 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085052    6774 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085054    6774 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085057    6774 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085059    6774 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085062    6774 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085065    6774 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085068    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085071    6774 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085073    6774 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085076    6774 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085078    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085081    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085084    6774 feature_gate.go:386] unrecognized feature gate: Example
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085086    6774 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 03 21:30:30.101836 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085089    6774 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085092    6774 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085095    6774 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085097    6774 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085100    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085103    6774 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085106    6774 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085108    6774 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085113    6774 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085115    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085118    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085121    6774 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085124    6774 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085126    6774 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085129    6774 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085131    6774 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085134    6774 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085137    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085139    6774 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085142    6774 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 03 21:30:30.102372 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085144    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085147    6774 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085150    6774 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085153    6774 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085156    6774 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085159    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085162    6774 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085164    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085167    6774 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085171    6774 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085175    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085179    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085182    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085184    6774 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085187    6774 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085191    6774 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085194    6774 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085196    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085199    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 03 21:30:30.102897 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085202    6774 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085204    6774 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085207    6774 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085212    6774 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085217    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085220    6774 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085223    6774 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085226    6774 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085230    6774 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085233    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085236    6774 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085239    6774 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085242    6774 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085244    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085247    6774 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085251    6774 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085253    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085256    6774 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085259    6774 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 03 21:30:30.103436 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085261    6774 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085264    6774 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085267    6774 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085269    6774 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085272    6774 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085275    6774 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085277    6774 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:30.085280    6774 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.085334    6774 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.086351    6774 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.086403    6774 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.086601    6774 server.go:1014] "Starting client certificate rotation"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.086733    6774 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.086787    6774 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 21:24:15 +0000 UTC" deadline="2028-07-25 17:44:55.102062124 +0000 UTC"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.086826    6774 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15116h14m25.015237896s"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.087113    6774 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:30:30.103918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.088207    6774 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 03 21:30:30.104319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.089401    6774 log.go:25] "Validated CRI v1 runtime API"
Nov 03 21:30:30.104319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.091502    6774 log.go:25] "Validated CRI v1 image API"
Nov 03 21:30:30.104319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.092211    6774 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 03 21:30:30.104319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.094558    6774 fs.go:135] Filesystem UUIDs: map[18e825f4-2538-4c77-a695-1b527aa83616:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d7e21e57-36f8-4389-90a7-c10c2769b51a:/dev/nvme0n1p4]
Nov 03 21:30:30.104475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.094575    6774 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87/userdata/shm major:0 minor:276 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76/userdata/shm major:0 minor:303 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944/userdata/shm major:0 minor:416 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/604d0a97c78d6043b873d3448b2aba75c4a573d1ecabd840359c1b38bf9dfd96/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/604d0a97c78d6043b873d3448b2aba75c4a573d1ecabd840359c1b38bf9dfd96/userdata/shm major:0 minor:473 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b/userdata/shm major:0 minor:249 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb/userdata/shm major:0 minor:314 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b46aaebb98e7e5b28a534d11d95f096981ad719fe249a2b0f0c076a57c8c85ef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b46aaebb98e7e5b28a534d11d95f096981ad719fe249a2b0f0c076a57c8c85ef/userdata/shm major:0 minor:474 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae/userdata/shm major:0 minor:283 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed/userdata/shm major:0 minor:332 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc/userdata/shm major:0 minor:477 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355/userdata/shm major:0 minor:423 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03a303b3-2834-490f-8835-b62c1f14e058/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/03a303b3-2834-490f-8835-b62c1f14e058/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/104d10b5-1122-4387-90ee-317e6cbed43f/volumes/kubernetes.io~projected/kube-api-access-rskgp:{mountpoint:/var/lib/kubelet/pods/104d10b5-1122-4387-90ee-317e6cbed43f/volumes/kubernetes.io~projected/kube-api-access-rskgp major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1435ae86-9aeb-453a-b45f-1f490d891e59/volumes/kubernetes.io~projected/kube-api-access-2fwlh:{mountpoint:/var/lib/kubelet/pods/1435ae86-9aeb-453a-b45f-1f490d891e59/volumes/kubernetes.io~projected/kube-api-access-2fwlh major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1f036244-f039-410c-9580-d75499fbe5c6/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/1f036244-f039-410c-9580-d75499fbe5c6/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:471 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/243453a2-1472-4e79-8ff4-d2f1671f6139/volumes/kubernetes.io~projected/kube-api-access-5cl4c:{mountpoint:/var/lib/kubelet/pods/243453a2-1472-4e79-8ff4-d2f1671f6139/volumes/kubernetes.io~projected/kube-api-access-5cl4c major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/243453a2-1472-4e79-8ff4-d2f1671f6139/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/243453a2-1472-4e79-8ff4-d2f1671f6139/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2c8e6ad7-2d66-46ff-89b7-14f775a7362e/volumes/kubernetes.io~projected/kube-api-access-gf5l8:{mountpoint:/var/lib/kubelet/pods/2c8e6ad7-2d66-46ff-89b7-14f775a7362e/volumes/kubernetes.io~projected/kube-api-access-gf5l8 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~projected/kube-api-access-qssxh:{mountpoint:/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~projected/kube-api-access-qssxh major:0 minor:275 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:270 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:274 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~projected/kube-api-access-w76js:{mountpoint:/var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~projected/kube-api-access-w76js major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:245 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/alertmanager/9 major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/config-reloader/6 major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~empty-dir/config-out major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~projected/kube-api-access-dchfl:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~projected/kube-api-access-dchfl major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~projected/tls-assets major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/config-volume major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/web-config major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f883755-74f9-491d-97ac-98ec31061ea6/volumes/kubernetes.io~projected/kube-api-access-rb7pb:{mountpoint:/var/lib/kubelet/pods/4f883755-74f9-491d-97ac-98ec31061ea6/volumes/kubernetes.io~projected/kube-api-access-rb7pb major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b/volumes/kubernetes.io~projected/kube-api-access-pfhdn:{mountpoint:/var/lib/kubelet/pods/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b/volumes/kubernetes.io~projected/kube-api-access-pfhdn major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b/volumes/kubernetes.io~secret/metrics-certs major:0 minor:466 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~projected/kube-api-access-j7dvk:{mountpoint:/var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~projected/kube-api-access-j7dvk major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:280 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:281 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volumes/kubernetes.io~projected/kube-api-access-snlnk:{mountpoint:/var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volumes/kubernetes.io~projected/kube-api-access-snlnk major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/config-reloader/2 major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/prometheus/15 major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~empty-dir/config-out major:0 minor:405 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~projected/kube-api-access-7pbwg:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~projected/kube-api-access-7pbwg major:0 minor:415 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~projected/tls-assets major:0 minor:408 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/config major:0 minor:410 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:413 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:412 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:409 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:407 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:400 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:414 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:411 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/web-config major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f8c1025-febc-406d-b362-6f3de07dbfaa/volumes/kubernetes.io~projected/kube-api-access-8xmv9:{mountpoint:/var/lib/kubelet/pods/7f8c1025-febc-406d-b362-6f3de07dbfaa/volumes/kubernetes.io~projected/kube-api-access-8xmv9 major:0 minor:472 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~projected/kube-api-access-6jn45:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~projected/kube-api-access-6jn45 major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904fbc27-d7c6-42c2-93fd-63170ed11ec4/volumes/kubernetes.io~projected/kube-api-access-b6php:{mountpoint:/var/lib/kubelet/pods/904fbc27-d7c6-42c2-93fd-63170ed11ec4/volumes/kubernetes.io~projected/kube-api-access-b6php major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904fbc27-d7c6-42c2-93fd-63170ed11ec4/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/904fbc27-d7c6-42c2-93fd-63170ed11ec4/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d/volumes/kubernetes.io~projected/kube-api-access-lcnzg:{mountpoint:/var/lib/kubelet/pods/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d/volumes/kubernetes.io~projected/kube-api-access-lcnzg major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3f294b3-83b7-4325-a70f-e784655b40e7/volumes/kubernetes.io~projected/kube-api-access-ftxhg:{mountpoint:/var/lib/kubelet/pods/b3f294b3-83b7-4325-a70f-e784655b40e7/volumes/kubernetes.io~projected/kube-api-access-ftxhg major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~projected/kube-api-access-d9gj5:{mountpoint:/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~projected/kube-api-access-d9gj5 major:0 minor:422 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:420 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:421 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~projected/kube-api-access-9w9cs:{mountpoint:/var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~projected/kube-api-access-9w9cs major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed40ebcf-733f-46d5-9967-bb6b61f58fa5/volumes/kubernetes.io~projected/kube-api-access-p7vl9:{mountpoint:/var/lib/kubelet/pods/ed40ebcf-733f-46d5-9967-bb6b61f58fa5/volumes/kubernetes.io~projected/kube-api-access-p7vl9 major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed40ebcf-733f-46d5-9967-bb6b61f58fa5/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/ed40ebcf-733f-46d5-9967-bb6b61f58fa5/volumes/kubernetes.io~secret/cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fedc7eb9-d1c5-4532-9bee-819c931a2358/volumes/kubernetes.io~projected/kube-api-access-phkc7:{mountpoint:/var/lib/kubelet/pods/fedc7eb9-d1c5-4532-9bee-819c931a2358/volumes/kubernetes.io~projected/kube-api-access-phkc7 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~projected/kube-api-access-ctjfh:{mountpoint:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~projected/kube-api-access-ctjfh major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:328 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/82f3096b3989bd731540b913f87a774b2d7f9e156a9775821aa90e17f08e9f55/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/074efea5493955d2f2ab8fbde84b6ef004247cdebd7f4ce7ecd30c9776ad5c2a/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/d9f2d0584335320348c59fe3a4b1771162e996c77c765126ca8e500dd86a039a/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/1ec3464ccded539df5838d55fecd708b944061f270fb460c5a56d7139ecd1da5/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4c9e3a7ff46153c2d0ffbc53c226041d5074ea7fd3b9eade29aca4103bf1513b/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/9a81c7ec2d5b25fbfb6c28490673fe5d0bf4c7e39f152b5f3537472236f43cc3/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/811ce89cf7dac8f03cdcb27c01d75046866b809ede14c70dba79158ff4df9e63/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/af6878bdc2d1aa8597e2b474e5ea5ac42b91f1b780c9eec6e1abe1f19ffedaab/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/ee9f40ad7fedc44c14e10a1ef2e38af5a7b684ae320db26a2df91604ef0697ee/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/2d5181af7661eb101ba413d49067bef35dcba1830eb1dc2b8a38c5aff3bc93d1/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/614088a5c27dc9e0ac4e63f2b2aee318c7e45c4b5aff59718e2e0bd3d8cb52b5/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/5f1c1b80660bc81a1e237c44765326550210f0e5454362b35e552dd1b2eb1a27/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/64352b292e41f639e016954b048e26c5655be1f669d6535dfe3c585b0eccf4a0/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/e86521c1bf14267d766a903f6cf514c4ad00eef0d0d2aae1632ab3e2e92e429b/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/7df4d7e7a35a3e5f816c3113044a32abbb6cce28fb2976dd9df0e1e557bc99f9/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/effabd3d5d128be4b3d4e3cceb1f0b4482e2881658560f76f46661035b8f5a15/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/f8656e25cb6e8000807f90e2d84e4486ee42b4951e00121ce41042e622466da0/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/06af0cd405093e9ca30658afc5c53ba549a39e0a5899c92be93fa7eb86ea5863/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/2b2ca309e3938a818c35834b3f2c6dbae63ebb16b353eecde642035ccc1bb69a/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e349fc60370f61f2820bcc2d4a9208d91a5b2dfff35cd6c74923c03a8b5d5d39/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/8855c8e7fc49a965b2c9c41de69af6c77d0e34af8b9fb19172cc6b4f636e0c2f/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/104858feb543dddc3eaa40e8a35327bd2074c281ee18aa2cdf3894d87d177091/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/50614ac3fb2bce5e8e8637fd684fd9354889dd7dc2ba73d9971a3f9252a6b6f0/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/8b994bac0d7c0126b4a46598ce16684bd2b3ba4cfe22b52df94cc0ece33bb42d/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/a620ee6e84405ce3d2b8dfd10be061876fe3dd9b07a884068c3ce286c569f448/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-226:{mountpoint:/var/lib/containers/storage/overlay/8746a8f94c6bbe8606094033aaf709607a00b50689a908c88fc277b501464237/merged major:0 minor:226 fsType:overlay blockSize:0} overlay_0-228:{mountpoint:/var/lib/containers/storage/overlay/a630d4fc27f2aa0fb419d50eb0019c62060336893ab11abd8985ee99271355eb/merged major:0 minor:228 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/60f2f53dcdaa28595be06334a95e3e6551217bf709d5a3810eac091e294481ca/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/90da3aaeadb2f3d61525d6e3649f55aaf998c4dbe5db702f400321cd638910fb/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/b6c043a19edc9b501245647bd726228615cb49df2c4f5121a8bb320dd0c9028e/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/5bf6daa5b565b11c0fd7893d55aff3c4274d01c890c3296211d01948cfe80eea/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/0fe8d04a2db81c3449bd2123555afcb8a1d08e0da8cd12f4489595499fc6a69f/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/711535128b60fc7de32208a27f2f8fbb76ef29e14eb6cedf6f173639d765e6df/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/753e5c5f760308f8692464aa8b1c46e816cda32009aad830e702fba8339e88de/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/7d4b323e44baf65431446c7ccec58ffbb58f36a7d9443e0ebaf921f3449a5e71/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-285:{mountpoint:/var/lib/containers/storage/overlay/821bc0dca728330d4f994c62a9816362826186f285fbd5ec90243121016dc39f/merged major:0 minor:285 fsType:overlay blockSize:0} overlay_0-287:{mountpoint:/var/lib/containers/storage/overlay/28ae07239119bc53350c358d47e6451d327b04664d5db2eb7422852541db52b5/merged major:0 minor:287 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/9186f34af51c0a48a79a8cc9929fcb778f32e2898e8c84346e1c160810097ee9/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/ac3b00e435f0c872e06b04617db02be1c922c017d936b08979789a02739c51ae/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-318:{mountpoint:/var/lib/containers/storage/overlay/66890f3ad7c5d10c1c7f445b28212befd0b4ee761ab8cff02198e02885da8a14/merged major:0 minor:318 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/9d3b811197e0f4f820a18ffff9674abdabc1f30fde271ba063d7f9a7bfd742ba/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/c40eeeb5c0f35af1404dd47c4e9d74828062bdd40b6a752a4327f5307307120c/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/c83028ffce64d88276d3626bc643d72bb974a8b38ef2aa400f92dda247c3f872/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/20d5ca25898af8a7fe2c740b6d0b86706ef09cab437c0024b5b531b3955be5fa/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/a0e32a25a0b08a0c67b65ae5e7f2a0f437287f6038e7367eb7201bc5e5d3da57/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/9f7f9394d517226f8f9ce6aa549d73aec0b3f39ad7ccc68d075f80a73ae6a3e2/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/3cbc3023eb7a1de9afadb926df5b40d924d063dbfffd5303ca05359cd311bc51/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/87ead8f834325daf2e10aa9ca653c385c5ab23d14b0508250b67c5b2307d6de5/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/61b3962b65e24713a8d431b30109e7889d6cd28af4088dfcb8477e10bc01fa66/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/4a1da5b87b53882639ecf6d614cb0ab83d8278072b089141ac1ef3e271298461/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-375:{mountpoint:/var/lib/containers/storage/overlay/fc73a8e22735f0a83b6d79f19227a7e0ed4ebb6adff9c9c400801c0a1642fba1/merged major:0 minor:375 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/f603d2bd26f62ef3621c3748a5bd051aeb9f856cd9aa9ce0b794a6e393e44746/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-382:{mountpoint:/var/lib/containers/storage/overlay/dc3852bc645f131117047074be250d2c4e4c3b81b20030338e91d3ea21a63b50/merged major:0 minor:382 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/cd932e1438c413e771c3f831d7b4847cea8ab467912c64ed0d04057ca7665111/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/b7d734192d27cb6eaa6ca51eff1c1d30de301cdb15ab65e98d5a5396569a04f3/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/cc0ec48ba21af011353f0335827bf7b0876cd89089aa6cd936d3b7c0996ae4e8/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/935b5854f0e47fd716d1407ed8db85694e7f13b194e5aeeea0c146986aad9c15/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/4406cac8cfdffe2696005c8d24acb074dc4171371804d030162514c6bfe78db1/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-429:{mountpoint:/var/lib/containers/storage/overlay/bfa41423186b5ee0a1b552708c4abe4952d163e12631ada4765386742846a855/merged major:0 minor:429 fsType:overlay blockSize:0} overlay_0-435:{mountpoint:/var/lib/containers/storage/overlay/292c4bbf942bbfb8f972032cf5d624005324a0447d6fd6f32d65eb3a171f92f4/merged major:0 minor:435 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/d8038279388449b6c765841dc9c126dfb55d024729e4e8046310734a2bc82210/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-446:{mountpoint:/var/lib/containers/storage/overlay/f4e36a75b56ac6ca192d51a50cc4bdb99db8ad4466fc6b55563f2cc0f729a14b/merged major:0 minor:446 fsType:overlay blockSize:0} overlay_0-451:{mountpoint:/var/lib/containers/storage/overlay/22f3c4be31f57994a74ff12eaf8d68e91502ddf8ad5564864d84ca4e8caf1b6a/merged major:0 minor:451 fsType:overlay blockSize:0} overlay_0-456:{mountpoint:/var/lib/containers/storage/overlay/48272d4b48fb5b71b98896b7c0640ccbd304b02b998812c931443184f6df413d/merged major:0 minor:456 fsType:overlay blockSize:0} overlay_0-461:{mountpoint:/var/lib/containers/storage/overlay/1acd147f5573a91757046a9d4faf8182a8a754cd9adeff3b2f8329bd044885ba/merged major:0 minor:461 fsType:overlay blockSize:0} overlay_0-479:{mountpoint:/var/lib/containers/storage/overlay/2988c3e9818fa423278007ceb23993e281b6c1427dfabc4e0e91411bcfbbb8d7/merged major:0 minor:479 fsType:overlay blockSize:0} overlay_0-481:{mountpoint:/var/lib/containers/storage/overlay/ae79f1b0c67eb59e52447d9d86355a299c0bfde13d9ccdbbabbdbe52c5d79354/merged major:0 minor:481 fsType:overlay blockSize:0} overlay_0-483:{mountpoint:/var/lib/containers/storage/overlay/da1a0a6a2ef8b16cf8b3be6558cd624add78fe614d18636c971c8f84d424a79a/merged major:0 minor:483 fsType:overlay blockSize:0} overlay_0-485:{mountpoint:/var/lib/containers/storage/overlay/72a1e8bf9f234d8e8428bc42d00e7f17bf82cd69567ee7a8733a0693f6c935e8/merged major:0 minor:485 fsType:overlay blockSize:0} overlay_0-487:{mountpoint:/var/lib/containers/storage/overlay/7bfad36d14c2f52ba836370b56e374462b89fa182d5816c55371421ba9ce7d15/merged major:0 minor:487 fsType:overlay blockSize:0} overlay_0-493:{mountpoint:/var/lib/containers/storage/overlay/2a6ca23714f09ca776cc65475d0da753a1d80bacb76df2e359a2a16a7e240482/merged major:0 minor:493 fsType:overlay blockSize:0} overlay_0-498:{mountpoint:/var/lib/containers/storage/overlay/a141c634d9ef7e6c5a3547874bbaa2de46143e89668b3929be0a9b8b485d0bce/merged major:0 minor:498 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/a7c8fb7c6d1879e1a78b3a72ca60ebfc140b5d13c2503cd282ccfdcdc494210e/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/e3ff91da21c54096f278b95f116987a5dd9ccc6a385e53fdcea94a4970e93811/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/1b63b367e54d5791299803a2279e9ada98b2e697be64315ea9c8e4f4c8f43402/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/f47b4aa13f0e8c5a3eb4f232bc57097b8992da3d7841674a7619d3671da34f80/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/5ebd1fbb48eff827de0c54b472ee0c01bc020609fccc8d19e7579ce801e51141/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/41df9adfb3e94b80d95ae31bddcbd44ce4a4c1caa61c29854a371d29364881dc/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/26de784b04cb1a16536fdf93691febf92528767ec81ec9fc1f335e9e12a3c939/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/8bba99ae9ad984c47caca40bdccca17495771d4c4c505cd166e04b762692d764/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/69826ae17a2a5b8474d38e68efa6abdf530495fb5486110269578caa4f1c1ebf/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/36da6df7eb182a5bcc26fedd69442bc80a025ca8897d59d4a4a2b78fb713794c/merged major:0 minor:98 fsType:overlay blockSize:0}]
Nov 03 21:30:30.105726 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.105214    6774 manager.go:217] Machine: {Timestamp:2026-11-03 21:30:30.104745579 +0000 UTC m=+0.071582304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097827 MemoryCapacity:33164345344 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de430362f90afe1b5b43a5ba013d5 SystemUUID:ec2de430-362f-90af-e1b5-b43a5ba013d5 BootID:0e300b38-0ba5-47ba-affd-9542ea273113 Filesystems:[{Device:/run/containers/storage/overlay-containers/d70c013559c5ac81177a0ec76c41cfbdc29238fe58263ba2d9805a3f2ea0cd7e/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4f883755-74f9-491d-97ac-98ec31061ea6/volumes/kubernetes.io~projected/kube-api-access-rb7pb DeviceMajor:0 DeviceMinor:219 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:329 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:298 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-493 DeviceMajor:0 DeviceMinor:493 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bfd562b62383cb8bb9689cf32cf5bf0a1d1d749eebf737b804657fc59e21f5d4/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:330 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-487 DeviceMajor:0 DeviceMinor:487 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/104d10b5-1122-4387-90ee-317e6cbed43f/volumes/kubernetes.io~projected/kube-api-access-rskgp DeviceMajor:0 DeviceMinor:62 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2df508325f095fefae903664450da3327948219abeb40ab6b932da80d01bb9f2/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/99aea6e622d034500c9c55b68d15f53ef40ad31fcce6fe05fa49a89ff78b1b41/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:295 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:295 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:281 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/904fbc27-d7c6-42c2-93fd-63170ed11ec4/volumes/kubernetes.io~projected/kube-api-access-b6php DeviceMajor:0 DeviceMinor:202 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:309 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1435ae86-9aeb-453a-b45f-1f490d891e59/volumes/kubernetes.io~projected/kube-api-access-2fwlh DeviceMajor:0 DeviceMinor:64 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96b540cddb7d9402995068eda845018dedf8645ae74043f02f05285b9668783a/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69261a9bdb88f8698124d3dd1e024a19a29ffd1bc4b20a32b36957a37189e36b/userdata/shm DeviceMajor:0 DeviceMinor:249 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:312 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/243453a2-1472-4e79-8ff4-d2f1671f6139/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:298 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:409 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944/userdata/shm DeviceMajor:0 DeviceMinor:416 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355/userdata/shm DeviceMajor:0 DeviceMinor:423 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:310 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a002f85c7e5daa7564c648961b3b79020456fec45c868c6da66858b735e6f0cb/userdata/shm DeviceMajor:0 DeviceMinor:314 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:414 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:420 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:406 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/1f036244-f039-410c-9580-d75499fbe5c6/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:471 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/fedc7eb9-d1c5-4532-9bee-819c931a2358/volumes/kubernetes.io~projected/kube-api-access-phkc7 DeviceMajor:0 DeviceMinor:59 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/081097a31a9d48f7bccf25ba3d58fbe7cf85206eac45f16765a5a7a3128ef3eb/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-226 DeviceMajor:0 DeviceMinor:226 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:301 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:405 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:466 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:298 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f8c1025-febc-406d-b362-6f3de07dbfaa/volumes/kubernetes.io~projected/kube-api-access-8xmv9 DeviceMajor:0 DeviceMinor:472 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b46aaebb98e7e5b28a534d11d95f096981ad719fe249a2b0f0c076a57c8c85ef/userdata/shm DeviceMajor:0 DeviceMinor:474 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volumes/kubernetes.io~projected/kube-api-access-snlnk DeviceMajor:0 DeviceMinor:67 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-375 DeviceMajor:0 DeviceMinor:375 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:411 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~projected/kube-api-access-7pbwg DeviceMajor:0 DeviceMinor:415 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:294 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:328 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~projected/kube-api-access-d9gj5 DeviceMajor:0 DeviceMinor:422 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-429 DeviceMajor:0 DeviceMinor:429 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-483 DeviceMajor:0 DeviceMinor:483 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582172672 Type:vfs Inodes:4048382 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e0a136e885164027b1885d5bed42b57caf113bf17619ecdc769d629bed91a04d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed40ebcf-733f-46d5-9967-bb6b61f58fa5/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:203 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~projected/kube-api-access-dchfl DeviceMajor:0 DeviceMinor:302 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:311 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-318 DeviceMajor:0 DeviceMinor:318 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:410 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:412 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:413 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:245 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:298 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-382 DeviceMajor:0 DeviceMinor:382 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/604d0a97c78d6043b873d3448b2aba75c4a573d1ecabd840359c1b38bf9dfd96/userdata/shm DeviceMajor:0 DeviceMinor:473 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~projected/kube-api-access-qssxh DeviceMajor:0 DeviceMinor:275 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c89f3c93f5ed5cbf3a55e45eb713040a9172393919b1ed94e1c0dc5a242d1dae/userdata/shm DeviceMajor:0 DeviceMinor:283 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:406 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ed40ebcf-733f-46d5-9967-bb6b61f58fa5/volumes/kubernetes.io~projected/kube-api-access-p7vl9 DeviceMajor:0 DeviceMinor:204 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:406 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/df2352a877d2fb21d39b98adf468b29a373fa6e0218f690f97fc429260bc98dc/userdata/shm DeviceMajor:0 DeviceMinor:477 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-228 DeviceMajor:0 DeviceMinor:228 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-287 DeviceMajor:0 DeviceMinor:287 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b03915d706d8b7003688d20ad29f4c485ccc023c2aa5629fd37bcf69f5731904/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/899373055e8201c751e1ed4849b309dd6f3d191d72bff23f53b296c2c6fb95d5/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:421 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-456 DeviceMajor:0 DeviceMinor:456 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d/volumes/kubernetes.io~projected/kube-api-access-lcnzg DeviceMajor:0 DeviceMinor:60 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~projected/kube-api-access-w76js DeviceMajor:0 DeviceMinor:246 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:406 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-435 DeviceMajor:0 DeviceMinor:435 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2c8e6ad7-2d66-46ff-89b7-14f775a7362e/volumes/kubernetes.io~projected/kube-api-access-gf5l8 DeviceMajor:0 DeviceMinor:66 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/088bb546340d8a1ece0ec4342512907a02de40c27d078d3ba52ac65fc2c3c7f8/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~projected/kube-api-access-j7dvk DeviceMajor:0 DeviceMinor:282 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:400 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-451 DeviceMajor:0 DeviceMinor:451 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/904fbc27-d7c6-42c2-93fd-63170ed11ec4/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:296 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:300 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-479 DeviceMajor:0 DeviceMinor:479 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-481 DeviceMajor:0 DeviceMinor:481 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b/volumes/kubernetes.io~projected/kube-api-access-pfhdn DeviceMajor:0 DeviceMinor:63 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77f3ee94a3cf49488883bb10fd9071ce7033293f57fe5d5b1a42827fde062361/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76/userdata/shm DeviceMajor:0 DeviceMinor:303 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:270 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-485 DeviceMajor:0 DeviceMinor:485 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3f294b3-83b7-4325-a70f-e784655b40e7/volumes/kubernetes.io~projected/kube-api-access-ftxhg DeviceMajor:0 DeviceMinor:61 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/c2a214c4-5527-4293-9d24-374350f224c8/volumes/kubernetes.io~projected/kube-api-access-9w9cs DeviceMajor:0 DeviceMinor:65 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:274 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:299 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4584a052-9e3d-4daf-b707-e4a584abcb74/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:241 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:307 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~projected/kube-api-access-6jn45 DeviceMajor:0 DeviceMinor:313 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/fee08312-111b-48d2-923b-b5b5ea20260c/volumes/kubernetes.io~projected/kube-api-access-ctjfh DeviceMajor:0 DeviceMinor:331 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:407 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:408 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-461 DeviceMajor:0 DeviceMinor:461 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7c7c3ddb-1837-429e-8b13-8a70a82cb841/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/243453a2-1472-4e79-8ff4-d2f1671f6139/volumes/kubernetes.io~projected/kube-api-access-5cl4c DeviceMajor:0 DeviceMinor:201 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87/userdata/shm DeviceMajor:0 DeviceMinor:276 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:289 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:297 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/03a303b3-2834-490f-8835-b62c1f14e058/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-498 DeviceMajor:0 DeviceMinor:498 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8e420431eb095b9cbe6f9c8b16083021a8c115436dc9ff1b05c76709ae6c5f2f/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/var/lib/kubelet/pods/7b489156-3ebf-4f7f-b5c5-8fe4999ed900/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:280 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-285 DeviceMajor:0 DeviceMinor:285 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82ddd449-8baa-4a8c-a505-ede3ef9abeea/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:308 Capacity:31985745920 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d8242d4fae54ca609ce8454a84eb0734bef4c671da4d9e031fb4b093e9acfbed/userdata/shm DeviceMajor:0 DeviceMinor:332 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048382 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-446 DeviceMajor:0 DeviceMinor:446 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:081097a31a9d48f MacAddress:4e:07:6d:f8:eb:80 Speed:10000 Mtu:8901} {Name:20ec2bf371bec84 MacAddress:3a:9d:d0:06:34:cd Speed:10000 Mtu:8901} {Name:429d884e6667352 MacAddress:ae:ce:f1:f4:5c:7f Speed:10000 Mtu:8901} {Name:574997eecb29da5 MacAddress:2e:6a:49:5b:18:c7 Speed:10000 Mtu:8901} {Name:604d0a97c78d604 MacAddress:5a:68:62:a0:2f:b5 Speed:10000 Mtu:8901} {Name:69261a9bdb88f86 MacAddress:da:ac:bf:a1:f9:53 Speed:10000 Mtu:8901} {Name:899373055e8201c MacAddress:ae:ee:2a:cf:a0:6d Speed:10000 Mtu:8901} {Name:8e420431eb095b9 MacAddress:02:b1:92:19:af:36 Speed:10000 Mtu:8901} {Name:a002f85c7e5daa7 MacAddress:ba:36:95:5a:96:92 Speed:10000 Mtu:8901} {Name:b46aaebb98e7e5b MacAddress:52:75:cf:dc:a7:f9 Speed:10000 Mtu:8901} {Name:bfd562b62383cb8 MacAddress:1a:1d:e0:44:d6:9e Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:cf:1b:5e:17 Speed:0 Mtu:9001} {Name:br-int MacAddress:ea:87:00:cf:94:aa Speed:0 Mtu:8901} {Name:d8242d4fae54ca6 MacAddress:f2:ec:ef:9b:ed:4e Speed:10000 Mtu:8901} {Name:df2352a877d2fb2 MacAddress:8e:bf:78:0e:5b:31 Speed:10000 Mtu:8901} {Name:e700c63716b8f17 MacAddress:ae:4f:44:4d:e1:49 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:cf:1b:5e:17 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:0e:98:76:b3:6a:07 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:fa:68:db:78:da:34 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164345344 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 03 21:30:30.106061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.105731    6774 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 03 21:30:30.106061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.105779    6774 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 03 21:30:30.106213 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106182    6774 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 03 21:30:30.106371 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106214    6774 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 03 21:30:30.106484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106375    6774 topology_manager.go:143] "Creating topology manager with none policy"
Nov 03 21:30:30.106484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106388    6774 container_manager_linux.go:311] "Creating device plugin manager"
Nov 03 21:30:30.106484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106401    6774 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:30:30.106484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106449    6774 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 03 21:30:30.106735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106582    6774 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 03 21:30:30.106824 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106810    6774 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 03 21:30:30.106959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106947    6774 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 03 21:30:30.107019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.106996    6774 kubelet.go:493] "Attempting to sync node with API server"
Nov 03 21:30:30.107019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.107016    6774 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 03 21:30:30.107109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.107030    6774 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 03 21:30:30.107109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.107043    6774 kubelet.go:405] "Adding apiserver pod source"
Nov 03 21:30:30.107109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.107056    6774 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 03 21:30:30.107902 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.107887    6774 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 21:30:30.107902 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.107901    6774 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:30:30.108441 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.108412    6774 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 03 21:30:30.111588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.111573    6774 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 03 21:30:30.111588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.111585    6774 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 03 21:30:30.111714 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.111704    6774 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 03 21:30:30.111912 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.111900    6774 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 03 21:30:30.111941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.111930    6774 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 03 21:30:30.112042 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112034    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 03 21:30:30.112077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112048    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 03 21:30:30.112077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112054    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 03 21:30:30.112077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112061    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 03 21:30:30.112077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112066    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 03 21:30:30.112077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112072    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112099    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112105    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112112    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112118    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112132    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112141    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112165    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 03 21:30:30.112246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.112171    6774 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 03 21:30:30.115614 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.115600    6774 server.go:1263] "Started kubelet"
Nov 03 21:30:30.116511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.115676    6774 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 03 21:30:30.116511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.115690    6774 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 03 21:30:30.116511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.115772    6774 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 03 21:30:30.116511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.116192    6774 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 03 21:30:30.116164 ip-10-0-142-174 systemd[1]: Started Kubernetes Kubelet.
Nov 03 21:30:30.118228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.118207    6774 server.go:317] "Adding debug handlers to kubelet server"
Nov 03 21:30:30.121096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121078    6774 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 03 21:30:30.121329 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121314    6774 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 03 21:30:30.121565 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121477    6774 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 03 21:30:30.121565 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121484    6774 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 03 21:30:30.121565 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.121552    6774 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-174.ec2.internal\" not found"
Nov 03 21:30:30.121737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121663    6774 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 21:24:17 +0000 UTC" deadline="2028-07-03 10:37:40.534570035 +0000 UTC"
Nov 03 21:30:30.121737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121695    6774 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14581h7m10.412878392s"
Nov 03 21:30:30.121827 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.121739    6774 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 03 21:30:30.123806 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.123766    6774 factory.go:55] Registering systemd factory
Nov 03 21:30:30.123888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.123809    6774 factory.go:223] Registration of the systemd container factory successfully
Nov 03 21:30:30.125329 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125311    6774 factory.go:153] Registering CRI-O factory
Nov 03 21:30:30.125329 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125329    6774 factory.go:223] Registration of the crio container factory successfully
Nov 03 21:30:30.125476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125398    6774 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 03 21:30:30.125476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125438    6774 factory.go:103] Registering Raw factory
Nov 03 21:30:30.125476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125456    6774 manager.go:1199] Started watching for new ooms in manager
Nov 03 21:30:30.125771 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125758    6774 manager.go:319] Starting recovery of all containers
Nov 03 21:30:30.125965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125914    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-tls" seLinuxMountContext=""
Nov 03 21:30:30.126035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125969    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="104d10b5-1122-4387-90ee-317e6cbed43f" volumeName="kubernetes.io/projected/104d10b5-1122-4387-90ee-317e6cbed43f-kube-api-access-rskgp" seLinuxMountContext=""
Nov 03 21:30:30.126035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125984    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c8e6ad7-2d66-46ff-89b7-14f775a7362e" volumeName="kubernetes.io/projected/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-kube-api-access-gf5l8" seLinuxMountContext=""
Nov 03 21:30:30.126035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.125998    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" volumeName="kubernetes.io/projected/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-kube-api-access-j7dvk" seLinuxMountContext=""
Nov 03 21:30:30.126035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126013    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.126035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126025    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126037    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3f294b3-83b7-4325-a70f-e784655b40e7" volumeName="kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-binary-copy" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126063    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c8e6ad7-2d66-46ff-89b7-14f775a7362e" volumeName="kubernetes.io/configmap/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-iptables-alerter-script" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126078    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" volumeName="kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-metrics-client-ca" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126090    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-client-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126103    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b" volumeName="kubernetes.io/projected/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-kube-api-access-pfhdn" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126115    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126131    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1435ae86-9aeb-453a-b45f-1f490d891e59" volumeName="kubernetes.io/projected/1435ae86-9aeb-453a-b45f-1f490d891e59-kube-api-access-2fwlh" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126144    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126158    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c7c3ddb-1837-429e-8b13-8a70a82cb841" volumeName="kubernetes.io/projected/7c7c3ddb-1837-429e-8b13-8a70a82cb841-kube-api-access-snlnk" seLinuxMountContext=""
Nov 03 21:30:30.126288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126211    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904fbc27-d7c6-42c2-93fd-63170ed11ec4" volumeName="kubernetes.io/projected/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-api-access-b6php" seLinuxMountContext=""
Nov 03 21:30:30.127456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.126226    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config" seLinuxMountContext=""
Nov 03 21:30:30.127551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127470    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Nov 03 21:30:30.127551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127496    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4584a052-9e3d-4daf-b707-e4a584abcb74" volumeName="kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 03 21:30:30.127551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127509    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f8c1025-febc-406d-b362-6f3de07dbfaa" volumeName="kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9" seLinuxMountContext=""
Nov 03 21:30:30.127551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127523    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config" seLinuxMountContext=""
Nov 03 21:30:30.127551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127536    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/projected/fee08312-111b-48d2-923b-b5b5ea20260c-kube-api-access-ctjfh" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127550    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127573    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904fbc27-d7c6-42c2-93fd-63170ed11ec4" volumeName="kubernetes.io/secret/904fbc27-d7c6-42c2-93fd-63170ed11ec4-insights-runtime-extractor-tls" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127581    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9bcd7686-5fc7-4fc4-8b3c-cc233a14379d" volumeName="kubernetes.io/projected/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kube-api-access-lcnzg" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127589    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127596    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="243453a2-1472-4e79-8ff4-d2f1671f6139" volumeName="kubernetes.io/empty-dir/243453a2-1472-4e79-8ff4-d2f1671f6139-tmp-dir" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127605    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127616    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127625    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4584a052-9e3d-4daf-b707-e4a584abcb74" volumeName="kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-tls" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127644    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" volumeName="kubernetes.io/empty-dir/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-textfile" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127653    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c7c3ddb-1837-429e-8b13-8a70a82cb841" volumeName="kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-config" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127670    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127677    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127686    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127693    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127700    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c2a214c4-5527-4293-9d24-374350f224c8" volumeName="kubernetes.io/projected/c2a214c4-5527-4293-9d24-374350f224c8-kube-api-access-9w9cs" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127708    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127715    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="243453a2-1472-4e79-8ff4-d2f1671f6139" volumeName="kubernetes.io/configmap/243453a2-1472-4e79-8ff4-d2f1671f6139-config-volume" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127722    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127730    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127738    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c2a214c4-5527-4293-9d24-374350f224c8" volumeName="kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-tmp" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127746    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fedc7eb9-d1c5-4532-9bee-819c931a2358" volumeName="kubernetes.io/projected/fedc7eb9-d1c5-4532-9bee-819c931a2358-kube-api-access-phkc7" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127773    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="243453a2-1472-4e79-8ff4-d2f1671f6139" volumeName="kubernetes.io/projected/243453a2-1472-4e79-8ff4-d2f1671f6139-kube-api-access-5cl4c" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127782    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127789    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" volumeName="kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-tls" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127798    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127805    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fedc7eb9-d1c5-4532-9bee-819c931a2358" volumeName="kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-daemon-config" seLinuxMountContext=""
Nov 03 21:30:30.127798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127814    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03a303b3-2834-490f-8835-b62c1f14e058" volumeName="kubernetes.io/configmap/03a303b3-2834-490f-8835-b62c1f14e058-konnectivity-ca" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127822    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="243453a2-1472-4e79-8ff4-d2f1671f6139" volumeName="kubernetes.io/secret/243453a2-1472-4e79-8ff4-d2f1671f6139-metrics-tls" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127830    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127837    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f883755-74f9-491d-97ac-98ec31061ea6" volumeName="kubernetes.io/empty-dir/4f883755-74f9-491d-97ac-98ec31061ea6-tmp" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127845    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127853    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904fbc27-d7c6-42c2-93fd-63170ed11ec4" volumeName="kubernetes.io/configmap/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127860    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127868    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1435ae86-9aeb-453a-b45f-1f490d891e59" volumeName="kubernetes.io/configmap/1435ae86-9aeb-453a-b45f-1f490d891e59-serviceca" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127895    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4584a052-9e3d-4daf-b707-e4a584abcb74" volumeName="kubernetes.io/configmap/4584a052-9e3d-4daf-b707-e4a584abcb74-metrics-client-ca" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127903    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127912    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-tls" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127919    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904fbc27-d7c6-42c2-93fd-63170ed11ec4" volumeName="kubernetes.io/empty-dir/904fbc27-d7c6-42c2-93fd-63170ed11ec4-data-volume" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127927    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/empty-dir/fee08312-111b-48d2-923b-b5b5ea20260c-audit-log" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127935    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c7c3ddb-1837-429e-8b13-8a70a82cb841" volumeName="kubernetes.io/secret/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127942    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/projected/82ddd449-8baa-4a8c-a505-ede3ef9abeea-kube-api-access-6jn45" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127950    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fedc7eb9-d1c5-4532-9bee-819c931a2358" volumeName="kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-cni-binary-copy" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127960    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127971    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127978    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3f294b3-83b7-4325-a70f-e784655b40e7" volumeName="kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127986    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c2a214c4-5527-4293-9d24-374350f224c8" volumeName="kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-etc-tuned" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.127993    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128000    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128008    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-grpc-tls" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128016    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3f294b3-83b7-4325-a70f-e784655b40e7" volumeName="kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128023    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed40ebcf-733f-46d5-9967-bb6b61f58fa5" volumeName="kubernetes.io/projected/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-kube-api-access-p7vl9" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128031    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128039    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128046    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128054    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128063    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128071    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="104d10b5-1122-4387-90ee-317e6cbed43f" volumeName="kubernetes.io/empty-dir/104d10b5-1122-4387-90ee-317e6cbed43f-tmp-dir" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128078    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" volumeName="kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128085    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-client-certs" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128093    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128101    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3f294b3-83b7-4325-a70f-e784655b40e7" volumeName="kubernetes.io/projected/b3f294b3-83b7-4325-a70f-e784655b40e7-kube-api-access-ftxhg" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128109    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128116    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128123    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128130    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c7c3ddb-1837-429e-8b13-8a70a82cb841" volumeName="kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-script-lib" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128138    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128146    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128154    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128161    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fee08312-111b-48d2-923b-b5b5ea20260c" volumeName="kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-metrics-server-audit-profiles" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128170    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128176    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f883755-74f9-491d-97ac-98ec31061ea6" volumeName="kubernetes.io/projected/4f883755-74f9-491d-97ac-98ec31061ea6-kube-api-access-rb7pb" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128185    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6ced8c9c-dd43-4e53-bbf1-5a4314d2589b" volumeName="kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128192    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128199    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed40ebcf-733f-46d5-9967-bb6b61f58fa5" volumeName="kubernetes.io/secret/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-cert" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128206    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03a303b3-2834-490f-8835-b62c1f14e058" volumeName="kubernetes.io/secret/03a303b3-2834-490f-8835-b62c1f14e058-agent-certs" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128215    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128222    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128230    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/configmap/82ddd449-8baa-4a8c-a505-ede3ef9abeea-metrics-client-ca" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128239    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1f036244-f039-410c-9580-d75499fbe5c6" volumeName="kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128246    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128254    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4584a052-9e3d-4daf-b707-e4a584abcb74" volumeName="kubernetes.io/projected/4584a052-9e3d-4daf-b707-e4a584abcb74-kube-api-access-w76js" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128270    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128277    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82ddd449-8baa-4a8c-a505-ede3ef9abeea" volumeName="kubernetes.io/empty-dir/82ddd449-8baa-4a8c-a505-ede3ef9abeea-tmp" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128284    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128294    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128301    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128309    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="33ca70f3-0475-406c-b5ad-092bc5bf1630" volumeName="kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128325    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c6f450f-e102-45b9-9806-a4fca7282d06" volumeName="kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128333    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" volumeName="kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128341    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baac9c70-597d-4101-b1eb-aba133d57c37" volumeName="kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128369    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c7c3ddb-1837-429e-8b13-8a70a82cb841" volumeName="kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-env-overrides" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128380    6774 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e56c252-c9ea-4722-86a0-8d02dadabb64" volumeName="kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128401    6774 reconstruct.go:97] "Volume reconstruction finished"
Nov 03 21:30:30.129082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.128407    6774 reconciler.go:29] "Reconciler: start to sync state"
Nov 03 21:30:30.149771 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.149724    6774 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 03 21:30:30.151237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.151214    6774 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 03 21:30:30.151237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.151239    6774 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 03 21:30:30.151502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.151260    6774 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 03 21:30:30.151502 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.151298    6774 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 03 21:30:30.161363 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.161332    6774 generic.go:356] "Generic (PLEG): container finished" podID="a22bb0111a50402150fc2be957a1cf0d" containerID="1657503f1024eaad3dcc0acf97baa106e8e7d3b1cd1e4a046635da137a0680ed" exitCode=0
Nov 03 21:30:30.165825 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.165803    6774 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 03 21:30:30.165925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.165910    6774 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:30:30.165996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.165945    6774 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:30:30.174450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.174399    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e" exitCode=0
Nov 03 21:30:30.182332 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.182304    6774 generic.go:356] "Generic (PLEG): container finished" podID="7b489156-3ebf-4f7f-b5c5-8fe4999ed900" containerID="2c971f605602e768afe41497b7e566b89c6655ea912e83556327ad6c688c28ea" exitCode=0
Nov 03 21:30:30.189104 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.189084    6774 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:30:30.189304 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.189286    6774 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 03 21:30:30.191040 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.191019    6774 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="667c111891387a6950d4ca147457b0a3a1a088beaf9a04671d8fca930c297d91" exitCode=0
Nov 03 21:30:30.191040 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.191040    6774 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="5f9b4d8ae148bc5b901efbb4e36107033310d735533bca36193807a789560a94" exitCode=0
Nov 03 21:30:30.191170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.191047    6774 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="e235cfbf4b6311012ff9a10d424e538eedf07bda173a7c3f22043f2eb8292b4c" exitCode=0
Nov 03 21:30:30.191170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.191053    6774 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="9cd640ca2fdbba0cb01891e43974eafee1c813b8173413d14c2534e1e539f673" exitCode=0
Nov 03 21:30:30.191170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.191058    6774 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="e7023353b8a249b548e50c31c09837c57d5aa50e95927f49e2baac053846511d" exitCode=0
Nov 03 21:30:30.191170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.191063    6774 generic.go:356] "Generic (PLEG): container finished" podID="b3f294b3-83b7-4325-a70f-e784655b40e7" containerID="7f6991d280ddbbaea64cecfc709239230e6ce78fa2d0fb985162f48a9bc375a3" exitCode=0
Nov 03 21:30:30.209887 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.209859    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c" exitCode=0
Nov 03 21:30:30.242629 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.242572    6774 manager.go:324] Recovery completed
Nov 03 21:30:30.251369 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.251348    6774 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268367    6774 cpu_manager.go:226] "Starting" policy="none"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268386    6774 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268406    6774 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268573    6774 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268591    6774 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268615    6774 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268624    6774 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268631    6774 policy_none.go:50] "Start"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268644    6774 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268657    6774 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268834    6774 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268844    6774 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 03 21:30:30.269224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.268852    6774 policy_none.go:44] "Start"
Nov 03 21:30:30.273755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.273728    6774 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 03 21:30:30.276854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.276839    6774 manager.go:341] "Starting Device Plugin manager"
Nov 03 21:30:30.277403 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.276864    6774 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 03 21:30:30.277464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277407    6774 server.go:87] "Starting device plugin registration server"
Nov 03 21:30:30.277697 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277686    6774 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 03 21:30:30.277748 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277697    6774 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 03 21:30:30.277818 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277795    6774 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 03 21:30:30.277967 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277919    6774 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 03 21:30:30.278046 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277986    6774 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 03 21:30:30.278046 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.277998    6774 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 03 21:30:30.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.278036    6774 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T21:30:30.277966546Z","UUID":"8f4fdaff-1555-4600-af28-9ce7e56262be","Handler":null,"Name":"","Endpoint":""}
Nov 03 21:30:30.279543 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.279528    6774 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 03 21:30:30.279614 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.279553    6774 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 03 21:30:30.279614 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.279589    6774 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 03 21:30:30.379065 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.379024    6774 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 03 21:30:30.380929 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.380911    6774 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientMemory"
Nov 03 21:30:30.381037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.380944    6774 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasNoDiskPressure"
Nov 03 21:30:30.381037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.380959    6774 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-174.ec2.internal" event="NodeHasSufficientPID"
Nov 03 21:30:30.381037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.381022    6774 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.413229 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.413201    6774 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.413333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.413276    6774 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.451722 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.451658    6774 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"]
Nov 03 21:30:30.452285 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452251    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" event={"ID":"a22bb0111a50402150fc2be957a1cf0d","Type":"ContainerStarted","Data":"647ae0dc0d4a43eb2c2bde5bb96222b776e63fdf0ec9239d1907401833f26a54"}
Nov 03 21:30:30.452326 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452296    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" event={"ID":"a22bb0111a50402150fc2be957a1cf0d","Type":"ContainerDied","Data":"1657503f1024eaad3dcc0acf97baa106e8e7d3b1cd1e4a046635da137a0680ed"}
Nov 03 21:30:30.452326 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452319    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal" event={"ID":"a22bb0111a50402150fc2be957a1cf0d","Type":"ContainerStarted","Data":"7d1b4ad2eed1864303b59defb3d4531e9b40d543d2187518220a271e10f4d700"}
Nov 03 21:30:30.452389 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452329    6774 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.452389 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452381    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal" event={"ID":"f4e271960909dbae93ddf03ac1216c26","Type":"ContainerStarted","Data":"8297ca6f73c32a17fdf3dd52434a5074bfed93a2492de78b137cc2eabfa1925e"}
Nov 03 21:30:30.452477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452400    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal" event={"ID":"f4e271960909dbae93ddf03ac1216c26","Type":"ContainerStarted","Data":"c292494dbeb33024d42ecc2fa6e1fb2a8064820aa3122617fe67383265566ad8"}
Nov 03 21:30:30.452577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.452563    6774 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.476493 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.476469    6774 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:30:30.476577 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.476516    6774 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.477366 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.477347    6774 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:30:30.477400 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:30.477390    6774 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.567767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.567692    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.567767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.567741    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4e271960909dbae93ddf03ac1216c26-config\") pod \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" (UID: \"f4e271960909dbae93ddf03ac1216c26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.567767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.567766    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.668305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.668265    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.668488 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.668318    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.668488 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.668336    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4e271960909dbae93ddf03ac1216c26-config\") pod \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" (UID: \"f4e271960909dbae93ddf03ac1216c26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.668488 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.668283    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.668488 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.668377    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f4e271960909dbae93ddf03ac1216c26-config\") pod \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" (UID: \"f4e271960909dbae93ddf03ac1216c26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:30.668488 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:30.668416    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a22bb0111a50402150fc2be957a1cf0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" (UID: \"a22bb0111a50402150fc2be957a1cf0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:31.107866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.107835    6774 apiserver.go:52] "Watching apiserver"
Nov 03 21:30:31.158380 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.158352    6774 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 03 21:30:31.159051 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.159028    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p","openshift-network-diagnostics/network-check-target-qmh2m","openshift-dns/node-resolver-vd6hh","openshift-console/console-6f6c75dc87-bjqw5","openshift-image-registry/node-ca-c6h7b","openshift-ingress-canary/ingress-canary-9d85z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal","openshift-monitoring/prometheus-k8s-0","kube-system/global-pull-secret-syncer-fwwbw","openshift-ovn-kubernetes/ovnkube-node-r7hzz","openshift-monitoring/metrics-server-94f499b94-rbvsp","openshift-monitoring/node-exporter-4zmzr","openshift-monitoring/thanos-querier-5dff68f85f-d46qq","kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4","openshift-console/downloads-6dd789c8b7-ptcfx","openshift-multus/network-metrics-daemon-68p76","openshift-console/console-8468c44d4b-br6gz","openshift-cluster-node-tuning-operator/tuned-qwbnr","openshift-insights/insights-runtime-extractor-dm87h","openshift-monitoring/alertmanager-main-0","openshift-multus/multus-additional-cni-plugins-wbpzb","kube-system/konnectivity-agent-hmlfq","openshift-multus/multus-p7sb7","openshift-dns/dns-default-5kdw4","openshift-network-operator/iptables-alerter-4p7xb"]
Nov 03 21:30:31.173860 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.173825    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.174305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174285    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.174305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174289    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.174506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174408    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.174506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174468    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 03 21:30:31.174506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174486    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.174506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174492    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.174705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174526    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.174705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174530    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.174705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174642    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-2kjq7\""
Nov 03 21:30:31.174705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174648    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w4krc\""
Nov 03 21:30:31.174705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174678    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vzdjb\""
Nov 03 21:30:31.174705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174692    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6tvtx\""
Nov 03 21:30:31.174996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174880    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 03 21:30:31.174996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.174911    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 03 21:30:31.175099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.175006    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-6tkv6\""
Nov 03 21:30:31.175099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.175084    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.175247 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.175142    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 03 21:30:31.187819 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.187768    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.188238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188220    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 03 21:30:31.188357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188262    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.188357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188268    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188267    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188269    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 03 21:30:31.188357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188298    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 03 21:30:31.188357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188329    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188406    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188409    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188511    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188537    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188554    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188560    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188568    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188570    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188618    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188649    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188735    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188751    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188755    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Nov 03 21:30:31.188766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188758    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188833    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188886    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.188927    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189077    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189085    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189088    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-rf9jq\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189119    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bxcrl\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189138    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mhg7x\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189075    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xgwf4\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189139    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189123    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189183    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189188    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lp7fr\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189200    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189302    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189319    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189382    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d5mwz\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189398    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 03 21:30:31.189669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.189486    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qc6g7\""
Nov 03 21:30:31.200386 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200361    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 03 21:30:31.200539 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200413    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 03 21:30:31.200539 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200483    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 03 21:30:31.200666 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200629    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 03 21:30:31.200729 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200689    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 03 21:30:31.200789 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200762    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Nov 03 21:30:31.200930 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.200909    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 03 21:30:31.202948 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.202926    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 03 21:30:31.205506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.204965    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 03 21:30:31.207078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.205840    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 03 21:30:31.207078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.206350    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 03 21:30:31.221379 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.221363    6774 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:31.221519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.221507    6774 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:31.225044 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.225027    6774 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 03 21:30:31.243109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.243086    6774 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:30:31.243207 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:31.243136    6774 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-174.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:31.243695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.243682    6774 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 03 21:30:31.243746 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:31.243713    6774 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-174.ec2.internal"
Nov 03 21:30:31.270689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270659    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.270841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270698    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-var-lib-kubelet\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.270841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270733    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.270841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270756    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-conf-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.270841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270783    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.270841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270808    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vl9\" (UniqueName: \"kubernetes.io/projected/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-kube-api-access-p7vl9\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:31.270841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270830    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a303b3-2834-490f-8835-b62c1f14e058-konnectivity-ca\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270853    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270878    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysconfig\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270903    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/904fbc27-d7c6-42c2-93fd-63170ed11ec4-crio-socket\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270925    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-host-slash\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270951    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270975    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.270998    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-netns\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271021    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/243453a2-1472-4e79-8ff4-d2f1671f6139-tmp-dir\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271046    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/104d10b5-1122-4387-90ee-317e6cbed43f-hosts-file\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271071    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1435ae86-9aeb-453a-b45f-1f490d891e59-host\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271105    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-kubelet\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.271133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271128    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271150    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271172    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271197    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-device-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271219    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-etc-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271247    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271271    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271294    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271314    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-modprobe-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271336    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-multus-certs\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271356    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-netns\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271386    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-netd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271409    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-cert\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271448    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271474    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271498    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271522    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271553    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271577    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a303b3-2834-490f-8835-b62c1f14e058-agent-certs\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271601    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271628    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-daemon-config\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271649    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkc7\" (UniqueName: \"kubernetes.io/projected/fedc7eb9-d1c5-4532-9bee-819c931a2358-kube-api-access-phkc7\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.271675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271672    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271694    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-sys\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271719    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-textfile\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271742    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271762    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-dbus\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271787    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271810    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-run\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271831    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-etc-tuned\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271868    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ddd449-8baa-4a8c-a505-ede3ef9abeea-metrics-client-ca\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271889    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-sys\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271908    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271929    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-log-socket\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271951    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.271984    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272007    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-systemd\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272030    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272062    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272087    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf5l8\" (UniqueName: \"kubernetes.io/projected/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-kube-api-access-gf5l8\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272111    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272136    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272166    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272192    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272215    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272240    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272268    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dvk\" (UniqueName: \"kubernetes.io/projected/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-kube-api-access-j7dvk\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272293    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-cni-binary-copy\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272317    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-k8s-cni-cncf-io\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272341    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-etc-kubernetes\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272372    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272398    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272451    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272478    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272503    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272530    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4584a052-9e3d-4daf-b707-e4a584abcb74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272554    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272577    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-ovn\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272599    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f883755-74f9-491d-97ac-98ec31061ea6-tmp\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272626    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272655    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272678    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-conf\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272706    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w9cs\" (UniqueName: \"kubernetes.io/projected/c2a214c4-5527-4293-9d24-374350f224c8-kube-api-access-9w9cs\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272730    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-kubelet\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272755    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/904fbc27-d7c6-42c2-93fd-63170ed11ec4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272779    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272803    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272826    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-multus\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272850    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-bin\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272875    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.272886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272901    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fwlh\" (UniqueName: \"kubernetes.io/projected/1435ae86-9aeb-453a-b45f-1f490d891e59-kube-api-access-2fwlh\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272926    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272949    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.272980    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273007    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/243453a2-1472-4e79-8ff4-d2f1671f6139-config-volume\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273031    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/243453a2-1472-4e79-8ff4-d2f1671f6139-metrics-tls\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273055    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rskgp\" (UniqueName: \"kubernetes.io/projected/104d10b5-1122-4387-90ee-317e6cbed43f-kube-api-access-rskgp\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273081    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273106    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-var-lib-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273132    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snlnk\" (UniqueName: \"kubernetes.io/projected/7c7c3ddb-1837-429e-8b13-8a70a82cb841-kube-api-access-snlnk\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273159    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftxhg\" (UniqueName: \"kubernetes.io/projected/b3f294b3-83b7-4325-a70f-e784655b40e7-kube-api-access-ftxhg\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273185    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273213    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273241    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273258    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-kubernetes\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273275    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-tmp\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273300    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ddd449-8baa-4a8c-a505-ede3ef9abeea-tmp\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273317    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-client-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273333    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-slash\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273350    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273369    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb7pb\" (UniqueName: \"kubernetes.io/projected/4f883755-74f9-491d-97ac-98ec31061ea6-kube-api-access-rb7pb\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273385    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273405    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-tls\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273439    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovn-node-metrics-cert\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273469    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273715    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273738    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-tmp\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.273933    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-host\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274030    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-cert\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274087    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274287    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-daemon-config\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274357    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fedc7eb9-d1c5-4532-9bee-819c931a2358-cni-binary-copy\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274365    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03a303b3-2834-490f-8835-b62c1f14e058-agent-certs\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274369    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274480    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03a303b3-2834-490f-8835-b62c1f14e058-konnectivity-ca\") pod \"konnectivity-agent-hmlfq\" (UID: \"03a303b3-2834-490f-8835-b62c1f14e058\") " pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274522    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/243453a2-1472-4e79-8ff4-d2f1671f6139-config-volume\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274583    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/243453a2-1472-4e79-8ff4-d2f1671f6139-tmp-dir\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274632    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274639    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-accelerators-collector-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274682    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274740    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274863    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274875    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274920    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274931    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-textfile\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.274968    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-system-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275002    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275023    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275031    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-hostroot\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275047    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275076    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/904fbc27-d7c6-42c2-93fd-63170ed11ec4-data-volume\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275109    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cl4c\" (UniqueName: \"kubernetes.io/projected/243453a2-1472-4e79-8ff4-d2f1671f6139-kube-api-access-5cl4c\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275139    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-iptables-alerter-script\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275176    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275199    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ddd449-8baa-4a8c-a505-ede3ef9abeea-metrics-client-ca\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275206    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275218    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 03 21:30:31.275221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275239    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-socket-dir-parent\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275270    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1435ae86-9aeb-453a-b45f-1f490d891e59-serviceca\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275273    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275288    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275300    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-tls\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275331    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275367    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctjfh\" (UniqueName: \"kubernetes.io/projected/fee08312-111b-48d2-923b-b5b5ea20260c-kube-api-access-ctjfh\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275384    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275396    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275446    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275478    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-cnibin\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275498    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/904fbc27-d7c6-42c2-93fd-63170ed11ec4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275509    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275543    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-env-overrides\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275559    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82ddd449-8baa-4a8c-a505-ede3ef9abeea-tmp\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275574    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-metrics-client-ca\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275581    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275032    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2a214c4-5527-4293-9d24-374350f224c8-etc-tuned\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275616    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275504    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275725    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275758    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275760    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275860    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275917    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.275976    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276099    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276179    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276321    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f036244-f039-410c-9580-d75499fbe5c6-original-pull-secret\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276351    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276377    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276385    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/243453a2-1472-4e79-8ff4-d2f1671f6139-metrics-tls\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276409    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276467    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276536    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276551    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-iptables-alerter-script\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276542    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4584a052-9e3d-4daf-b707-e4a584abcb74-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276381    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276577    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276596    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276640    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-grpc-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276630    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276679    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276715    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276748    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276765    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276784    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnzg\" (UniqueName: \"kubernetes.io/projected/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kube-api-access-lcnzg\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276816    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-systemd-units\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.276869    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhdn\" (UniqueName: \"kubernetes.io/projected/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-kube-api-access-pfhdn\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277041    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277164    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277171    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-wtmp\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277206    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-kubelet-config\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277233    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f883755-74f9-491d-97ac-98ec31061ea6-tmp\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277242    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-metrics-server-audit-profiles\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277266    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277273    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-systemd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277329    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-script-lib\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277366    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6php\" (UniqueName: \"kubernetes.io/projected/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-api-access-b6php\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277371    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277398    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/104d10b5-1122-4387-90ee-317e6cbed43f-tmp-dir\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277417    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1435ae86-9aeb-453a-b45f-1f490d891e59-serviceca\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277471    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277574    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/904fbc27-d7c6-42c2-93fd-63170ed11ec4-data-volume\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277621    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-script-lib\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277636    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-metrics-client-ca\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277637    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277757    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/104d10b5-1122-4387-90ee-317e6cbed43f-tmp-dir\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277783    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277804    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-root\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277828    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277833    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fee08312-111b-48d2-923b-b5b5ea20260c-metrics-server-audit-profiles\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277851    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277895    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jn45\" (UniqueName: \"kubernetes.io/projected/82ddd449-8baa-4a8c-a505-ede3ef9abeea-kube-api-access-6jn45\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277899    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-env-overrides\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277965    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.277986    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278046    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-68dsn\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278058    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278114    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-94tnq\""
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278140    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-lib-modules\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.278135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278187    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dlfpp\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278287    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-bin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278329    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-node-log\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278393    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278486    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-cnibin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278517    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278547    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278629    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278656    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fee08312-111b-48d2-923b-b5b5ea20260c-audit-log\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278693    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278735    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76js\" (UniqueName: \"kubernetes.io/projected/4584a052-9e3d-4daf-b707-e4a584abcb74-kube-api-access-w76js\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278738    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4584a052-9e3d-4daf-b707-e4a584abcb74-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278886    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278918    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278970    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278982    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279004    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-client-certs\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279041    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279058    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tnnmd\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279073    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279075    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-config\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.278935    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fee08312-111b-48d2-923b-b5b5ea20260c-audit-log\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279098    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dunbs395f4ba0\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279278    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279329    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279357    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-client-certs\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279386    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279447    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279480    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279570    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279722    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279760    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovnkube-config\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279805    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279868    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.279904    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b3f294b3-83b7-4325-a70f-e784655b40e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280051    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x9smh\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280152    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280272    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280392    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280492    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280578    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4tzc5\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280619    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9x4ll\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280620    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qcvh8\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280639    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-26q9x\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280612    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-fv5g9\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280669    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280728    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280848    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280921    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2kqbs5fqdbd96\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.280963    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.281057    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.281115    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.281207    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jzc78\""
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.281363    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.282519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.281452    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 03 21:30:31.284532 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.282564    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4sin7sg16ubmh\""
Nov 03 21:30:31.284532 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.283987    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-metrics-certs\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:31.284532 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.284130    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-client-ca-bundle\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285332    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285387    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285336    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285390    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fee08312-111b-48d2-923b-b5b5ea20260c-secret-metrics-server-tls\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285409    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285409    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285454    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.285502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285476    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c7c3ddb-1837-429e-8b13-8a70a82cb841-ovn-node-metrics-cert\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.285838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285563    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.285838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285549    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.285838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285629    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.285838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285682    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.285838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285682    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.285838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.285730    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.286873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.286855    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.286937 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.286883    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-tls\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.286937 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.286899    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.286998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.286932    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.288076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.288064    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.288184 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.288166    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82ddd449-8baa-4a8c-a505-ede3ef9abeea-secret-grpc-tls\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.289162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.289147    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.291121 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.290620    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vl9\" (UniqueName: \"kubernetes.io/projected/ed40ebcf-733f-46d5-9967-bb6b61f58fa5-kube-api-access-p7vl9\") pod \"ingress-canary-9d85z\" (UID: \"ed40ebcf-733f-46d5-9967-bb6b61f58fa5\") " pod="openshift-ingress-canary/ingress-canary-9d85z"
Nov 03 21:30:31.291242 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.291210    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.291313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.291226    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.291578 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.291554    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") pod \"alertmanager-main-0\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:31.291880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.291843    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftxhg\" (UniqueName: \"kubernetes.io/projected/b3f294b3-83b7-4325-a70f-e784655b40e7-kube-api-access-ftxhg\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.291880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.291873    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snlnk\" (UniqueName: \"kubernetes.io/projected/7c7c3ddb-1837-429e-8b13-8a70a82cb841-kube-api-access-snlnk\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.292089 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.292068    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rskgp\" (UniqueName: \"kubernetes.io/projected/104d10b5-1122-4387-90ee-317e6cbed43f-kube-api-access-rskgp\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.292398 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.292361    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dvk\" (UniqueName: \"kubernetes.io/projected/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-kube-api-access-j7dvk\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.292609 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.292587    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb7pb\" (UniqueName: \"kubernetes.io/projected/4f883755-74f9-491d-97ac-98ec31061ea6-kube-api-access-rb7pb\") pod \"downloads-6dd789c8b7-ptcfx\" (UID: \"4f883755-74f9-491d-97ac-98ec31061ea6\") " pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:31.292733 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.292705    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") pod \"console-8468c44d4b-br6gz\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") " pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:31.300759 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.300733    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf5l8\" (UniqueName: \"kubernetes.io/projected/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-kube-api-access-gf5l8\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.300850 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.300834    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xmv9\" (UniqueName: \"kubernetes.io/projected/7f8c1025-febc-406d-b362-6f3de07dbfaa-kube-api-access-8xmv9\") pod \"network-check-target-qmh2m\" (UID: \"7f8c1025-febc-406d-b362-6f3de07dbfaa\") " pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:31.302273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.302253    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkc7\" (UniqueName: \"kubernetes.io/projected/fedc7eb9-d1c5-4532-9bee-819c931a2358-kube-api-access-phkc7\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.303475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.302890    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fwlh\" (UniqueName: \"kubernetes.io/projected/1435ae86-9aeb-453a-b45f-1f490d891e59-kube-api-access-2fwlh\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.303475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.302903    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") pod \"console-6f6c75dc87-bjqw5\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") " pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:31.303475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303318    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76js\" (UniqueName: \"kubernetes.io/projected/4584a052-9e3d-4daf-b707-e4a584abcb74-kube-api-access-w76js\") pod \"prometheus-operator-9cd89b74c-dlw9p\" (UID: \"4584a052-9e3d-4daf-b707-e4a584abcb74\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-dlw9p"
Nov 03 21:30:31.303475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303354    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w9cs\" (UniqueName: \"kubernetes.io/projected/c2a214c4-5527-4293-9d24-374350f224c8-kube-api-access-9w9cs\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.303475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303403    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctjfh\" (UniqueName: \"kubernetes.io/projected/fee08312-111b-48d2-923b-b5b5ea20260c-kube-api-access-ctjfh\") pod \"metrics-server-94f499b94-rbvsp\" (UID: \"fee08312-111b-48d2-923b-b5b5ea20260c\") " pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:31.303475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303454    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6php\" (UniqueName: \"kubernetes.io/projected/904fbc27-d7c6-42c2-93fd-63170ed11ec4-kube-api-access-b6php\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.303810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303478    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhdn\" (UniqueName: \"kubernetes.io/projected/6ced8c9c-dd43-4e53-bbf1-5a4314d2589b-kube-api-access-pfhdn\") pod \"network-metrics-daemon-68p76\" (UID: \"6ced8c9c-dd43-4e53-bbf1-5a4314d2589b\") " pod="openshift-multus/network-metrics-daemon-68p76"
Nov 03 21:30:31.303810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303723    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") pod \"prometheus-k8s-0\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:31.303910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303837    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnzg\" (UniqueName: \"kubernetes.io/projected/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kube-api-access-lcnzg\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.303910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.303839    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jn45\" (UniqueName: \"kubernetes.io/projected/82ddd449-8baa-4a8c-a505-ede3ef9abeea-kube-api-access-6jn45\") pod \"thanos-querier-5dff68f85f-d46qq\" (UID: \"82ddd449-8baa-4a8c-a505-ede3ef9abeea\") " pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:31.304258 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.304235    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cl4c\" (UniqueName: \"kubernetes.io/projected/243453a2-1472-4e79-8ff4-d2f1671f6139-kube-api-access-5cl4c\") pod \"dns-default-5kdw4\" (UID: \"243453a2-1472-4e79-8ff4-d2f1671f6139\") " pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:31.380243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380167    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.380243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380200    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-var-lib-kubelet\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.380243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380217    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-conf-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.380243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380240    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysconfig\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380287    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-conf-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380323    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-var-lib-kubelet\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380358    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/904fbc27-d7c6-42c2-93fd-63170ed11ec4-crio-socket\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380396    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysconfig\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380404    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/904fbc27-d7c6-42c2-93fd-63170ed11ec4-crio-socket\") pod \"insights-runtime-extractor-dm87h\" (UID: \"904fbc27-d7c6-42c2-93fd-63170ed11ec4\") " pod="openshift-insights/insights-runtime-extractor-dm87h"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380403    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-host-slash\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380460    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-netns\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380463    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c8e6ad7-2d66-46ff-89b7-14f775a7362e-host-slash\") pod \"iptables-alerter-4p7xb\" (UID: \"2c8e6ad7-2d66-46ff-89b7-14f775a7362e\") " pod="openshift-network-operator/iptables-alerter-4p7xb"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380476    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/104d10b5-1122-4387-90ee-317e6cbed43f-hosts-file\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380363    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380491    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1435ae86-9aeb-453a-b45f-1f490d891e59-host\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380508    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-kubelet\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380519    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-netns\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380533    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-device-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380556    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/104d10b5-1122-4387-90ee-317e6cbed43f-hosts-file\") pod \"node-resolver-vd6hh\" (UID: \"104d10b5-1122-4387-90ee-317e6cbed43f\") " pod="openshift-dns/node-resolver-vd6hh"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380557    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-kubelet\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380558    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-etc-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380587    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-etc-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380595    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-device-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.380595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380602    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-modprobe-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380558    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1435ae86-9aeb-453a-b45f-1f490d891e59-host\") pod \"node-ca-c6h7b\" (UID: \"1435ae86-9aeb-453a-b45f-1f490d891e59\") " pod="openshift-image-registry/node-ca-c6h7b"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380646    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-multus-certs\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380664    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-netns\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380670    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-modprobe-d\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380687    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-netd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380699    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-netns\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380699    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-multus-certs\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380718    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380758    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380765    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380787    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380796    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-sys\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380813    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-dbus\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380760    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-netd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380861    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-sys\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380897    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-run\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380922    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-sys\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380971    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-dbus\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.380988    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381004    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-run\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381012    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-log-socket\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381022    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-sys\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381060    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-systemd\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381078    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381084    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-log-socket\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381098    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-k8s-cni-cncf-io\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381120    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-etc-kubernetes\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381138    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381136    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-systemd\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381098    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-sys-fs\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381138    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381167    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-etc-kubernetes\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381167    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-run-k8s-cni-cncf-io\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381188    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-ovn\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381203    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-socket-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381210    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-conf\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381234    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-ovn\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381249    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-kubelet\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381272    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-multus\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381284    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-kubelet\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381293    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-bin\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381316    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-sysctl-conf\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381325    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-multus\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381319    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-cni-bin\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381360    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381389    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381415    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-var-lib-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381432    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381454    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-kubernetes\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381480    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-var-lib-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381482    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9bcd7686-5fc7-4fc4-8b3c-cc233a14379d-registration-dir\") pod \"aws-ebs-csi-driver-node-t2tm4\" (UID: \"9bcd7686-5fc7-4fc4-8b3c-cc233a14379d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2tm4"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381479    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-slash\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381509    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-slash\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381517    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381519    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-etc-kubernetes\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381544    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-host-run-ovn-kubernetes\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381551    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381567    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-host\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381581    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-system-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381606    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381620    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-hostroot\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381638    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-socket-dir-parent\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381644    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-system-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381662    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-cnibin\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381683    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-systemd-units\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.381640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381687    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-host\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381705    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-wtmp\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381721    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-kubelet-config\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381731    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-cni-dir\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381735    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-systemd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381617    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381755    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-root\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381776    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-lib-modules\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381791    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-bin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381795    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3f294b3-83b7-4325-a70f-e784655b40e7-cnibin\") pod \"multus-additional-cni-plugins-wbpzb\" (UID: \"b3f294b3-83b7-4325-a70f-e784655b40e7\") " pod="openshift-multus/multus-additional-cni-plugins-wbpzb"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381804    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-node-log\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381815    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-hostroot\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381819    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-cnibin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381835    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-systemd-units\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381846    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381863    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-node-exporter-wtmp\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381776    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-multus-socket-dir-parent\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381901    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f036244-f039-410c-9580-d75499fbe5c6-kubelet-config\") pod \"global-pull-secret-syncer-fwwbw\" (UID: \"1f036244-f039-410c-9580-d75499fbe5c6\") " pod="kube-system/global-pull-secret-syncer-fwwbw"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381920    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-node-log\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381944    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2a214c4-5527-4293-9d24-374350f224c8-lib-modules\") pod \"tuned-qwbnr\" (UID: \"c2a214c4-5527-4293-9d24-374350f224c8\") " pod="openshift-cluster-node-tuning-operator/tuned-qwbnr"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381945    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-cnibin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381963    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-openvswitch\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381975    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7c7c3ddb-1837-429e-8b13-8a70a82cb841-run-systemd\") pod \"ovnkube-node-r7hzz\" (UID: \"7c7c3ddb-1837-429e-8b13-8a70a82cb841\") " pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.381986    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fedc7eb9-d1c5-4532-9bee-819c931a2358-host-var-lib-cni-bin\") pod \"multus-p7sb7\" (UID: \"fedc7eb9-d1c5-4532-9bee-819c931a2358\") " pod="openshift-multus/multus-p7sb7"
Nov 03 21:30:31.384814 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:31.382001    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b489156-3ebf-4f7f-b5c5-8fe4999ed900-root\") pod \"node-exporter-4zmzr\" (UID: \"7b489156-3ebf-4f7f-b5c5-8fe4999ed900\") " pod="openshift-monitoring/node-exporter-4zmzr"
Nov 03 21:30:33.290242 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:33.290212    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5dff68f85f-d46qq"
Nov 03 21:30:33.536822 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:33.536791    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5kdw4"
Nov 03 21:30:34.509604 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:34.509577    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:36.866054 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:36.866022    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:30:37.412806 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:37.412774    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:38.460977 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:38.460893    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:38.461438 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:38.461110    6774 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 03 21:30:38.752933 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:38.752864    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r7hzz"
Nov 03 21:30:39.267583 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:39.267553    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:39.773611 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:39.773581    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-ptcfx"
Nov 03 21:30:40.349920 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:40.349887    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-94f499b94-rbvsp"
Nov 03 21:30:49.289829 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.289792    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:49.290376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.290190    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="alertmanager" containerID="cri-o://1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9" gracePeriod=120
Nov 03 21:30:49.290376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.290264    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-metric" containerID="cri-o://d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11" gracePeriod=120
Nov 03 21:30:49.290376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.290312    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="prom-label-proxy" containerID="cri-o://0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737" gracePeriod=120
Nov 03 21:30:49.290376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.290306    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy" containerID="cri-o://49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0" gracePeriod=120
Nov 03 21:30:49.290376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.290266    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-web" containerID="cri-o://f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29" gracePeriod=120
Nov 03 21:30:49.291618 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:49.291218    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="config-reloader" containerID="cri-o://983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e" gracePeriod=120
Nov 03 21:30:50.295300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295259    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737" exitCode=0
Nov 03 21:30:50.295300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295293    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11" exitCode=0
Nov 03 21:30:50.295300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295302    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0" exitCode=0
Nov 03 21:30:50.295300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295310    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e" exitCode=0
Nov 03 21:30:50.295874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295300    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737"}
Nov 03 21:30:50.295874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295379    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11"}
Nov 03 21:30:50.295874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295318    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9" exitCode=0
Nov 03 21:30:50.295874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295404    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0"}
Nov 03 21:30:50.295874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295454    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e"}
Nov 03 21:30:50.295874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.295496    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9"}
Nov 03 21:30:50.581932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.581896    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:50.653650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653618    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.653851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653659    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.653851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653690    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.653851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653724    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.653851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653753    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.653851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653789    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.653851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653818    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653861    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653898    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653930    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.653966    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.654028    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.654077    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") pod \"4c6f450f-e102-45b9-9806-a4fca7282d06\" (UID: \"4c6f450f-e102-45b9-9806-a4fca7282d06\") "
Nov 03 21:30:50.654481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.654158    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:50.654481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.654455    6774 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.655844 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.655513    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:30:50.657854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.657624    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.657854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.657762    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:30:50.658023 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.657975    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.658275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.658234    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:50.658481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.658454    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.659256 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.659225    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:30:50.659540 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.659513    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.659934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.659910    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "kube-api-access-dchfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:30:50.660125 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.660105    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.662251 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.662160    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.669210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.669177    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config" pod "4c6f450f-e102-45b9-9806-a4fca7282d06" (UID: "4c6f450f-e102-45b9-9806-a4fca7282d06"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:50.755775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755736    6774 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-main-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.755775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755769    6774 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-config-out\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.755775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755781    6774 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-cluster-tls-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755789    6774 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-tls-assets\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755801    6774 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755809    6774 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4c6f450f-e102-45b9-9806-a4fca7282d06-alertmanager-main-db\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755818    6774 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755827    6774 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c6f450f-e102-45b9-9806-a4fca7282d06-metrics-client-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755836    6774 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755844    6774 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-config-volume\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755853    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dchfl\" (UniqueName: \"kubernetes.io/projected/4c6f450f-e102-45b9-9806-a4fca7282d06-kube-api-access-dchfl\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:50.756018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:50.755860    6774 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c6f450f-e102-45b9-9806-a4fca7282d06-web-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:51.302368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.302334    6774 generic.go:356] "Generic (PLEG): container finished" podID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerID="f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29" exitCode=0
Nov 03 21:30:51.302890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.302397    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29"}
Nov 03 21:30:51.302890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.302417    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.302890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.302498    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4c6f450f-e102-45b9-9806-a4fca7282d06","Type":"ContainerDied","Data":"429d884e666735233f4fb9dd3cb87db4bd800864d9ee76cc6aa5195a3050fb76"}
Nov 03 21:30:51.302890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.302553    6774 scope.go:122] "RemoveContainer" containerID="0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737"
Nov 03 21:30:51.311067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.311049    6774 scope.go:122] "RemoveContainer" containerID="d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11"
Nov 03 21:30:51.317912 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.317894    6774 scope.go:122] "RemoveContainer" containerID="49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0"
Nov 03 21:30:51.324507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.324489    6774 scope.go:122] "RemoveContainer" containerID="f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29"
Nov 03 21:30:51.331207 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.331178    6774 scope.go:122] "RemoveContainer" containerID="983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e"
Nov 03 21:30:51.338284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.338262    6774 scope.go:122] "RemoveContainer" containerID="1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9"
Nov 03 21:30:51.348245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.348215    6774 scope.go:122] "RemoveContainer" containerID="e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c"
Nov 03 21:30:51.355882 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.355861    6774 scope.go:122] "RemoveContainer" containerID="0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737"
Nov 03 21:30:51.356178 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.356148    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737\": container with ID starting with 0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737 not found: ID does not exist" containerID="0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737"
Nov 03 21:30:51.356253 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356192    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737"} err="failed to get container status \"0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737\": rpc error: code = NotFound desc = could not find container \"0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737\": container with ID starting with 0ea4ed02ec02b3931441a5b8e5fa8d6ab69080dea162c60881a25c701bcd4737 not found: ID does not exist"
Nov 03 21:30:51.356253 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356237    6774 scope.go:122] "RemoveContainer" containerID="d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11"
Nov 03 21:30:51.356514 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.356497    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11\": container with ID starting with d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11 not found: ID does not exist" containerID="d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11"
Nov 03 21:30:51.356559 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356522    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11"} err="failed to get container status \"d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11\": rpc error: code = NotFound desc = could not find container \"d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11\": container with ID starting with d362306ff43b3d7eb39cbbf5a20e871d81064acd22a7864e4127f640a8ed1d11 not found: ID does not exist"
Nov 03 21:30:51.356559 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356537    6774 scope.go:122] "RemoveContainer" containerID="49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0"
Nov 03 21:30:51.356757 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.356739    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0\": container with ID starting with 49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0 not found: ID does not exist" containerID="49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0"
Nov 03 21:30:51.356804 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356765    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0"} err="failed to get container status \"49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0\": rpc error: code = NotFound desc = could not find container \"49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0\": container with ID starting with 49c521793a7d1133a89df1e51d84e59848b2cd1ea00d495c0b6aedd21a32fce0 not found: ID does not exist"
Nov 03 21:30:51.356804 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356782    6774 scope.go:122] "RemoveContainer" containerID="f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29"
Nov 03 21:30:51.356970 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.356950    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29\": container with ID starting with f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29 not found: ID does not exist" containerID="f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29"
Nov 03 21:30:51.357027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356978    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29"} err="failed to get container status \"f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29\": rpc error: code = NotFound desc = could not find container \"f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29\": container with ID starting with f80c3d4bc05b0b7d74b235e3a628e0682cb295135a43f0f1a497e29116c75f29 not found: ID does not exist"
Nov 03 21:30:51.357027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.356998    6774 scope.go:122] "RemoveContainer" containerID="983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e"
Nov 03 21:30:51.357217 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.357201    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e\": container with ID starting with 983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e not found: ID does not exist" containerID="983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e"
Nov 03 21:30:51.357255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.357220    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e"} err="failed to get container status \"983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e\": rpc error: code = NotFound desc = could not find container \"983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e\": container with ID starting with 983e9435da387db2db7fa222f31776895fa6745b111a77082fcd624b3104ec4e not found: ID does not exist"
Nov 03 21:30:51.357255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.357233    6774 scope.go:122] "RemoveContainer" containerID="1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9"
Nov 03 21:30:51.357439 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.357404    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9\": container with ID starting with 1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9 not found: ID does not exist" containerID="1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9"
Nov 03 21:30:51.357509 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.357439    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9"} err="failed to get container status \"1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9\": rpc error: code = NotFound desc = could not find container \"1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9\": container with ID starting with 1a77b89a26ff2a9ff00cf75da4acc0b5a5461cecd0147af790d6f8abb2c3d4f9 not found: ID does not exist"
Nov 03 21:30:51.357509 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.357458    6774 scope.go:122] "RemoveContainer" containerID="e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c"
Nov 03 21:30:51.357674 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:51.357660    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c\": container with ID starting with e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c not found: ID does not exist" containerID="e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c"
Nov 03 21:30:51.357720 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.357677    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c"} err="failed to get container status \"e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c\": rpc error: code = NotFound desc = could not find container \"e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c\": container with ID starting with e4b48db33017f5e3f6a46ea5df333cedc4193e403d0fbd6ea5a39b74e94b390c not found: ID does not exist"
Nov 03 21:30:51.370141 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.370117    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:51.381716 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.381687    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:51.397297 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397273    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:51.397611 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397598    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-web"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397613    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-web"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397629    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="init-config-reloader"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397634    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="init-config-reloader"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397642    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="config-reloader"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397647    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="config-reloader"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397653    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="alertmanager"
Nov 03 21:30:51.397661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397657    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="alertmanager"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397665    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="prom-label-proxy"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397671    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="prom-label-proxy"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397681    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397686    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397695    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-metric"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397701    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-metric"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397763    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="prom-label-proxy"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397771    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397777    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-metric"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397786    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="kube-rbac-proxy-web"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397793    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="init-config-reloader"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397799    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="config-reloader"
Nov 03 21:30:51.397868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.397805    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" containerName="alertmanager"
Nov 03 21:30:51.433623 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.433592    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:51.433623 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.433609    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.448642 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.448613    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Nov 03 21:30:51.448831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.448635    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Nov 03 21:30:51.448831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.448630    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Nov 03 21:30:51.448831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.448752    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Nov 03 21:30:51.449181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.448936    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Nov 03 21:30:51.449181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.449000    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9x4ll\""
Nov 03 21:30:51.449181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.449001    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Nov 03 21:30:51.449181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.449022    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Nov 03 21:30:51.449181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.449050    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Nov 03 21:30:51.460749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.460729    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Nov 03 21:30:51.462391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462365    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11edbdba-555c-4733-b719-df6d8140e8a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462401    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr2ww\" (UniqueName: \"kubernetes.io/projected/11edbdba-555c-4733-b719-df6d8140e8a7-kube-api-access-fr2ww\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462444    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462569 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462524    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11edbdba-555c-4733-b719-df6d8140e8a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462569 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462550    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11edbdba-555c-4733-b719-df6d8140e8a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462634 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462590    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462679 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462661    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462713 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462705    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11edbdba-555c-4733-b719-df6d8140e8a7-config-out\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462804 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462783    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462848 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462836    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462856    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462873    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-web-config\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.462956 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.462890    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11edbdba-555c-4733-b719-df6d8140e8a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563440 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563342    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11edbdba-555c-4733-b719-df6d8140e8a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563440 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563381    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11edbdba-555c-4733-b719-df6d8140e8a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563445    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563475    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563515    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11edbdba-555c-4733-b719-df6d8140e8a7-config-out\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563557    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563594    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563619    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563643    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-web-config\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.563672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563667    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11edbdba-555c-4733-b719-df6d8140e8a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.564091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563700    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11edbdba-555c-4733-b719-df6d8140e8a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.564091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563724    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr2ww\" (UniqueName: \"kubernetes.io/projected/11edbdba-555c-4733-b719-df6d8140e8a7-kube-api-access-fr2ww\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.564091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563746    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.564091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.563887    6774 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 03 21:30:51.564091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.564046    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11edbdba-555c-4733-b719-df6d8140e8a7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.564345 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.564232    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11edbdba-555c-4733-b719-df6d8140e8a7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.564715 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.564688    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11edbdba-555c-4733-b719-df6d8140e8a7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.566863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.566836    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-config-volume\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.566863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.566855    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.567019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.566949    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.567019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.566977    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.567212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.567188    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11edbdba-555c-4733-b719-df6d8140e8a7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.567318 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.567225    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.567568 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.567542    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11edbdba-555c-4733-b719-df6d8140e8a7-config-out\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.567789 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.567771    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-web-config\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.568270 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.568250    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11edbdba-555c-4733-b719-df6d8140e8a7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.583936 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.583915    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr2ww\" (UniqueName: \"kubernetes.io/projected/11edbdba-555c-4733-b719-df6d8140e8a7-kube-api-access-fr2ww\") pod \"alertmanager-main-0\" (UID: \"11edbdba-555c-4733-b719-df6d8140e8a7\") " pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:51.839786 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:51.839696    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Nov 03 21:30:52.156828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:52.156794    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c6f450f-e102-45b9-9806-a4fca7282d06" path="/var/lib/kubelet/pods/4c6f450f-e102-45b9-9806-a4fca7282d06/volumes"
Nov 03 21:30:52.188230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:52.188204    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Nov 03 21:30:52.206120 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:52.206093    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11edbdba_555c_4733_b719_df6d8140e8a7.slice/crio-32fc4fd272dabf99041ecd4d91028a40fe07b41fc404d130a7542d53f4585dfc WatchSource:0}: Error finding container 32fc4fd272dabf99041ecd4d91028a40fe07b41fc404d130a7542d53f4585dfc: Status 404 returned error can't find the container with id 32fc4fd272dabf99041ecd4d91028a40fe07b41fc404d130a7542d53f4585dfc
Nov 03 21:30:52.308791 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:52.308766    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"f9fc5fa64bf3ef783623e07b707cb5ff26f767bdd925f06ca84c11191baf4eeb"}
Nov 03 21:30:52.309121 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:52.308827    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"32fc4fd272dabf99041ecd4d91028a40fe07b41fc404d130a7542d53f4585dfc"}
Nov 03 21:30:52.707784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:52.707751    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hmlfq"
Nov 03 21:30:53.316495 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.316456    6774 generic.go:356] "Generic (PLEG): container finished" podID="11edbdba-555c-4733-b719-df6d8140e8a7" containerID="f9fc5fa64bf3ef783623e07b707cb5ff26f767bdd925f06ca84c11191baf4eeb" exitCode=0
Nov 03 21:30:53.316893 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.316547    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerDied","Data":"f9fc5fa64bf3ef783623e07b707cb5ff26f767bdd925f06ca84c11191baf4eeb"}
Nov 03 21:30:53.873487 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.873451    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:53.873848 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.873822    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="prometheus" containerID="cri-o://b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c" gracePeriod=600
Nov 03 21:30:53.874231 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.874206    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-thanos" containerID="cri-o://064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d" gracePeriod=600
Nov 03 21:30:53.874336 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.874315    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy" containerID="cri-o://e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7" gracePeriod=600
Nov 03 21:30:53.874588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.874568    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-web" containerID="cri-o://f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225" gracePeriod=600
Nov 03 21:30:53.874756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.874740    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="thanos-sidecar" containerID="cri-o://b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f" gracePeriod=600
Nov 03 21:30:53.874907 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:53.874893    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="config-reloader" containerID="cri-o://f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8" gracePeriod=600
Nov 03 21:30:54.179434 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.179400    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.294468 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294434    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294654 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294476    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294654 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294505    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294654 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294626    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294830 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294705    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294830 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294742    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294830 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294812    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294993 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294846    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294993 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294884    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.294993 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294890    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.294993 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.294929    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295362    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.295511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295458    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295503    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295613 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295538    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295613 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295572    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295613 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295603    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295640    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295682    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295723    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295754    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.295896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.295800    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") pod \"7e56c252-c9ea-4722-86a0-8d02dadabb64\" (UID: \"7e56c252-c9ea-4722-86a0-8d02dadabb64\") "
Nov 03 21:30:54.296125 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.296101    6774 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.296209 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.296130    6774 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.297203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.296542    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.297203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.296569    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.297203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.297145    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.297693 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.297665    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.298634 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.298611    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:30:54.298914 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.298887    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:54.303124 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303090    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:30:54.303243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303097    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.303243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303187    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.303357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303276    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.303567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303536    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.303670 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303634    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.303862 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303817    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.304026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.303994    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "kube-api-access-7pbwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:30:54.304026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.304018    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:30:54.304185 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.304164    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.304393 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.304368    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.314411 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.314377    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config" pod "7e56c252-c9ea-4722-86a0-8d02dadabb64" (UID: "7e56c252-c9ea-4722-86a0-8d02dadabb64"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:54.324725 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.324694    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"84b8e9472a77dae82d54720fc8096aa16129377d4c2a2285e01974fc6486cdc0"}
Nov 03 21:30:54.325126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.324771    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"b94bee930806ca82c4e9f8ab9bfe9d8557f3135a766539fd44d0e2b117c844ab"}
Nov 03 21:30:54.325126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.324813    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"2baae848d034a83c581d94390930b857bfad53dd38d5ff06e13e5dabbbc79bb0"}
Nov 03 21:30:54.325126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.324847    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"e11ec41405ddc2d1012544ed4868fc05bbdc61687f90c90fcda1942eb5fb99ef"}
Nov 03 21:30:54.325126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.324883    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"c40d1e9558c70cc09e4026c7ddb9bf82c96f56b7e1199896836ed6ad9e09667e"}
Nov 03 21:30:54.325126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.324918    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11edbdba-555c-4733-b719-df6d8140e8a7","Type":"ContainerStarted","Data":"6af9ff5a548950ac52da029e17ee0f09116f09b83637cfad63eee625c42af6e3"}
Nov 03 21:30:54.329708 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329682    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d" exitCode=0
Nov 03 21:30:54.329708 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329703    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7" exitCode=0
Nov 03 21:30:54.329708 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329710    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225" exitCode=0
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329721    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f" exitCode=0
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329727    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8" exitCode=0
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329732    6774 generic.go:356] "Generic (PLEG): container finished" podID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c" exitCode=0
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329757    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329772    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"}
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329840    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"}
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329869    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"}
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329893    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"}
Nov 03 21:30:54.329952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329912    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.330413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.329916    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"}
Nov 03 21:30:54.330413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.330018    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"}
Nov 03 21:30:54.330413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.330042    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e56c252-c9ea-4722-86a0-8d02dadabb64","Type":"ContainerDied","Data":"574997eecb29da5a3ffea24e64bb5c5f1e087049a522db8ba06afbfaa22e4944"}
Nov 03 21:30:54.338233 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.338215    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.348611 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.348592    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.356448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.356414    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.363230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.363211    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.369997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.369943    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.351232783 podStartE2EDuration="3.369926473s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.69369ms" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:54.36883571 +0000 UTC m=+24.335672457" watchObservedRunningTime="2026-11-03 21:30:54.369926473 +0000 UTC m=+24.336763207"
Nov 03 21:30:54.374276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.374248    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.384493 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.384474    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.392649 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.392626    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.393002 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.392977    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.393076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.393016    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"} err="failed to get container status \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist"
Nov 03 21:30:54.393076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.393043    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.393344 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.393318    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.393482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.393352    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"} err="failed to get container status \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist"
Nov 03 21:30:54.393482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.393375    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.393747 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.393708    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.393820 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.393762    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"} err="failed to get container status \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist"
Nov 03 21:30:54.393820 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.393790    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.394077 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.394054    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.394144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394084    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"} err="failed to get container status \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist"
Nov 03 21:30:54.394144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394103    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.394377 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.394357    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.394507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394385    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"} err="failed to get container status \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist"
Nov 03 21:30:54.394507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394400    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.394688 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.394658    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.394744 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394694    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"} err="failed to get container status \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist"
Nov 03 21:30:54.394744 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394713    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.395010 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:30:54.394954    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.395010 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.394978    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"} err="failed to get container status \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist"
Nov 03 21:30:54.395010 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395000    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.395313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395288    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"} err="failed to get container status \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist"
Nov 03 21:30:54.395367 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395316    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.395616 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395594    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"} err="failed to get container status \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist"
Nov 03 21:30:54.395706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395616    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.395961 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395937    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"} err="failed to get container status \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist"
Nov 03 21:30:54.396032 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.395962    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.396288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396207    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"} err="failed to get container status \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist"
Nov 03 21:30:54.396288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396229    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396473    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"} err="failed to get container status \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist"
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396498    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396779    6774 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396801    6774 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-tls-assets\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396817    6774 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396834    6774 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-config-out\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396849    6774 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-kube-rbac-proxy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396862    6774 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-metrics-client-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396876    6774 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-web-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396890    6774 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396903    6774 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396916    6774 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396930    6774 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396944    6774 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-db\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396958    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pbwg\" (UniqueName: \"kubernetes.io/projected/7e56c252-c9ea-4722-86a0-8d02dadabb64-kube-api-access-7pbwg\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396973    6774 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-grpc-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.396989    6774 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e56c252-c9ea-4722-86a0-8d02dadabb64-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.397003    6774 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-configmap-metrics-client-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.397018    6774 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.397880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.397034    6774 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e56c252-c9ea-4722-86a0-8d02dadabb64-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:54.398740 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.398710    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"} err="failed to get container status \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist"
Nov 03 21:30:54.398740 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.398740    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.398981 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.398961    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"} err="failed to get container status \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist"
Nov 03 21:30:54.399044 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.398983    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.399220 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.399200    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"} err="failed to get container status \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist"
Nov 03 21:30:54.399220 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.399219    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.399534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.399505    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"} err="failed to get container status \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist"
Nov 03 21:30:54.399596 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.399535    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.399815 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.399795    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"} err="failed to get container status \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist"
Nov 03 21:30:54.399867 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.399816    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.400073 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400056    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"} err="failed to get container status \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist"
Nov 03 21:30:54.400112 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400074    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.400304 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400285    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"} err="failed to get container status \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist"
Nov 03 21:30:54.400350 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400305    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.400575 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400555    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"} err="failed to get container status \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist"
Nov 03 21:30:54.400648 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400576    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.400874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400854    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"} err="failed to get container status \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist"
Nov 03 21:30:54.400949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.400874    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.401115 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401097    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"} err="failed to get container status \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist"
Nov 03 21:30:54.401177 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401115    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.401330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401313    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"} err="failed to get container status \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist"
Nov 03 21:30:54.401377 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401331    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.401592 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401573    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"} err="failed to get container status \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist"
Nov 03 21:30:54.401671 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401593    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.401825 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401808    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"} err="failed to get container status \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist"
Nov 03 21:30:54.401899 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.401826    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.402046 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402029    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"} err="failed to get container status \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist"
Nov 03 21:30:54.402084 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402046    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.402293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402274    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"} err="failed to get container status \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist"
Nov 03 21:30:54.402374 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402294    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.402619 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402590    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"} err="failed to get container status \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist"
Nov 03 21:30:54.402619 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402618    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.402979 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402951    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"} err="failed to get container status \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist"
Nov 03 21:30:54.403062 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.402979    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.405606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.404646    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:54.405606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.404738    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"} err="failed to get container status \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist"
Nov 03 21:30:54.405606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.404757    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.405926 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.405900    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"} err="failed to get container status \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist"
Nov 03 21:30:54.405926 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.405925    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.406383 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.406358    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"} err="failed to get container status \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist"
Nov 03 21:30:54.406383 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.406382    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.406847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.406715    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"} err="failed to get container status \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist"
Nov 03 21:30:54.406847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.406743    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.407275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.407236    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"} err="failed to get container status \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist"
Nov 03 21:30:54.407368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.407276    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.407636 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.407610    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"} err="failed to get container status \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist"
Nov 03 21:30:54.407636 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.407635    6774 scope.go:122] "RemoveContainer" containerID="064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"
Nov 03 21:30:54.407901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.407882    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d"} err="failed to get container status \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": rpc error: code = NotFound desc = could not find container \"064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d\": container with ID starting with 064da886022ea0681e7aa5cade65292bee4957971b845015026bfec155091e4d not found: ID does not exist"
Nov 03 21:30:54.407901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.407901    6774 scope.go:122] "RemoveContainer" containerID="e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"
Nov 03 21:30:54.408134 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408104    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7"} err="failed to get container status \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": rpc error: code = NotFound desc = could not find container \"e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7\": container with ID starting with e126b068efdbfc68260357e4d251643bc8fec25cc5def728c3561a25dc6a8eb7 not found: ID does not exist"
Nov 03 21:30:54.408134 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408130    6774 scope.go:122] "RemoveContainer" containerID="f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"
Nov 03 21:30:54.408300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408220    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:54.408460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408410    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225"} err="failed to get container status \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": rpc error: code = NotFound desc = could not find container \"f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225\": container with ID starting with f07c1bfeb543fbc1c3bfe58a6ce08e4ea1db9d7df9c389f63734f4a174482225 not found: ID does not exist"
Nov 03 21:30:54.408460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408457    6774 scope.go:122] "RemoveContainer" containerID="b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"
Nov 03 21:30:54.408754 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408729    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f"} err="failed to get container status \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": rpc error: code = NotFound desc = could not find container \"b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f\": container with ID starting with b0cde05be61a140e062873c25de330909d0630888364f1841165e0921a50b22f not found: ID does not exist"
Nov 03 21:30:54.408879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.408755    6774 scope.go:122] "RemoveContainer" containerID="f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"
Nov 03 21:30:54.409095 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.409070    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8"} err="failed to get container status \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": rpc error: code = NotFound desc = could not find container \"f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8\": container with ID starting with f4e079a01bd3309bb3dab2eee20ab4425297db7b67f5acd4ec72ac084b458de8 not found: ID does not exist"
Nov 03 21:30:54.409184 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.409097    6774 scope.go:122] "RemoveContainer" containerID="b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"
Nov 03 21:30:54.409338 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.409313    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c"} err="failed to get container status \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": rpc error: code = NotFound desc = could not find container \"b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c\": container with ID starting with b2c6f4165acd5258e865c49b6a5ac1baa7c73888f83103da0f41e1986ae7499c not found: ID does not exist"
Nov 03 21:30:54.409403 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.409341    6774 scope.go:122] "RemoveContainer" containerID="0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"
Nov 03 21:30:54.409553 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.409534    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e"} err="failed to get container status \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": rpc error: code = NotFound desc = could not find container \"0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e\": container with ID starting with 0ba314db0e9e16795c09290cf31f436569fbbfa0da56e303d2c14fc136ecf09e not found: ID does not exist"
Nov 03 21:30:54.431144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431116    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:54.431404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431391    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="prometheus"
Nov 03 21:30:54.431464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431404    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="prometheus"
Nov 03 21:30:54.431464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431415    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="thanos-sidecar"
Nov 03 21:30:54.431464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431444    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="thanos-sidecar"
Nov 03 21:30:54.431464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431460    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431465    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431472    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="config-reloader"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431476    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="config-reloader"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431484    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="init-config-reloader"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431489    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="init-config-reloader"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431497    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-web"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431504    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-web"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431535    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-thanos"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431541    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-thanos"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431587    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="init-config-reloader"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431595    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-web"
Nov 03 21:30:54.431602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431604    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy-thanos"
Nov 03 21:30:54.432088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431610    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="prometheus"
Nov 03 21:30:54.432088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431616    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="thanos-sidecar"
Nov 03 21:30:54.432088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431623    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="kube-rbac-proxy"
Nov 03 21:30:54.432088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.431628    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" containerName="config-reloader"
Nov 03 21:30:54.452982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.452962    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.471223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.470499    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:54.471223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.470848    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Nov 03 21:30:54.471223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471032    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Nov 03 21:30:54.471223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471157    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Nov 03 21:30:54.471475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471272    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Nov 03 21:30:54.471475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471359    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Nov 03 21:30:54.471475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471469    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Nov 03 21:30:54.471612 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471596    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Nov 03 21:30:54.471659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471596    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Nov 03 21:30:54.471659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471628    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Nov 03 21:30:54.471659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471630    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Nov 03 21:30:54.471767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471746    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Nov 03 21:30:54.471832 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471814    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x9smh\""
Nov 03 21:30:54.471946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471914    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dunbs395f4ba0\""
Nov 03 21:30:54.471946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.471926    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Nov 03 21:30:54.483289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.483266    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Nov 03 21:30:54.483289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.483270    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Nov 03 21:30:54.497677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497653    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-config\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497763 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497682    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497763 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497698    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497763 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497721    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497869 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497826    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497869 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497856    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c40eff3-9bee-4747-8f55-f8c6d450cd63-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497929 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497877    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.497981 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.497969    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s5sn\" (UniqueName: \"kubernetes.io/projected/1c40eff3-9bee-4747-8f55-f8c6d450cd63-kube-api-access-5s5sn\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498016    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498070 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498039    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498070 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498054    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c40eff3-9bee-4747-8f55-f8c6d450cd63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498127 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498069    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498109    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498154    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498217 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498177    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498217 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498203    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498245    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498278    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498350 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498327    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.498383 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.498358    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.599524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599497    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.599687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599537    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.599687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599565    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.599687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599591    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.599687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599614    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.599687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599631    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599800    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-config\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599847    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599876    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599905    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599936    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.599972    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c40eff3-9bee-4747-8f55-f8c6d450cd63-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600003    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600031    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s5sn\" (UniqueName: \"kubernetes.io/projected/1c40eff3-9bee-4747-8f55-f8c6d450cd63-kube-api-access-5s5sn\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600080    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600116    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600141    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c40eff3-9bee-4747-8f55-f8c6d450cd63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600167    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600201    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600233    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600304    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600384    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600973 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600733    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.600973 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.600843    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.601344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.601130    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.602959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.602913    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603204 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603087    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-config\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603515 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603309    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603592 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603521    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603708 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603684    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603735    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603821 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603804    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c40eff3-9bee-4747-8f55-f8c6d450cd63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.603998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.603956    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.604483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.604458    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c40eff3-9bee-4747-8f55-f8c6d450cd63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.604580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.604482    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.605273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.605252    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c40eff3-9bee-4747-8f55-f8c6d450cd63-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.605795 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.605773    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.605907 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.605882    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.606137 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.606123    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c40eff3-9bee-4747-8f55-f8c6d450cd63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.621707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.621687    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s5sn\" (UniqueName: \"kubernetes.io/projected/1c40eff3-9bee-4747-8f55-f8c6d450cd63-kube-api-access-5s5sn\") pod \"prometheus-k8s-0\" (UID: \"1c40eff3-9bee-4747-8f55-f8c6d450cd63\") " pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:54.837173 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:54.837135    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:30:55.179349 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:55.179276    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Nov 03 21:30:55.183647 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:55.183620    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c40eff3_9bee_4747_8f55_f8c6d450cd63.slice/crio-9d202ba2f9aac7d0ffa1b6cf2f32e495f1f506b5b4e290896e95800b9205bb18 WatchSource:0}: Error finding container 9d202ba2f9aac7d0ffa1b6cf2f32e495f1f506b5b4e290896e95800b9205bb18: Status 404 returned error can't find the container with id 9d202ba2f9aac7d0ffa1b6cf2f32e495f1f506b5b4e290896e95800b9205bb18
Nov 03 21:30:55.334677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:55.334645    6774 generic.go:356] "Generic (PLEG): container finished" podID="1c40eff3-9bee-4747-8f55-f8c6d450cd63" containerID="0e93d6d25c4b587866cda6b944faa6e78567534444280da81508477c476fce80" exitCode=0
Nov 03 21:30:55.335085 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:55.334731    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerDied","Data":"0e93d6d25c4b587866cda6b944faa6e78567534444280da81508477c476fce80"}
Nov 03 21:30:55.335085 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:55.334807    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"9d202ba2f9aac7d0ffa1b6cf2f32e495f1f506b5b4e290896e95800b9205bb18"}
Nov 03 21:30:56.163902 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.163870    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e56c252-c9ea-4722-86a0-8d02dadabb64" path="/var/lib/kubelet/pods/7e56c252-c9ea-4722-86a0-8d02dadabb64/volumes"
Nov 03 21:30:56.188927 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.188893    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6f6c75dc87-bjqw5" podUID="33ca70f3-0475-406c-b5ad-092bc5bf1630" containerName="console" containerID="cri-o://01f933042e0cc948d9822fdc92acdf93c7f1bd0d3312cd847951ea2b234b183d" gracePeriod=15
Nov 03 21:30:56.343886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.343851    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"ea1cc5e76a1fe3ff807e29df902f80cc7f561f6e1856223da5a9743ae0100664"}
Nov 03 21:30:56.344333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.343935    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"9e555ee0398cf35d01aae8e7e56e3fea5a494c7cf1813985c3baefc7aa682994"}
Nov 03 21:30:56.344333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.343977    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"92bc92daa73189109fa3a4ae3249e4dfbd3b64576e0b6b98cac37db37fdfcc46"}
Nov 03 21:30:56.344333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.344017    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"7b2d11f927c8094afcc488db946484619f631e6458f02a2049056ab03924f5c5"}
Nov 03 21:30:56.344333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.344057    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"bb1ebd79be9c85f9234fa17d7b4f06de5a0fdb7d510459b37fbbe88075bee80c"}
Nov 03 21:30:56.344333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.344099    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c40eff3-9bee-4747-8f55-f8c6d450cd63","Type":"ContainerStarted","Data":"f570773f7570b1ee2ad576574f32481481a94503a9fe51cd2a46a28f347eafad"}
Nov 03 21:30:56.345534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.345511    6774 generic.go:356] "Generic (PLEG): container finished" podID="33ca70f3-0475-406c-b5ad-092bc5bf1630" containerID="01f933042e0cc948d9822fdc92acdf93c7f1bd0d3312cd847951ea2b234b183d" exitCode=0
Nov 03 21:30:56.345645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.345546    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6c75dc87-bjqw5" event={"ID":"33ca70f3-0475-406c-b5ad-092bc5bf1630","Type":"ContainerDied","Data":"01f933042e0cc948d9822fdc92acdf93c7f1bd0d3312cd847951ea2b234b183d"}
Nov 03 21:30:56.402760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.402705    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.391400813 podStartE2EDuration="2.402693269s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.292456ms" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:56.401173861 +0000 UTC m=+26.368010604" watchObservedRunningTime="2026-11-03 21:30:56.402693269 +0000 UTC m=+26.369530003"
Nov 03 21:30:56.484739 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.484711    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:56.521125 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521099    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521138    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521182    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521210    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521231    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521417 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521291    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521417 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521320    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") pod \"33ca70f3-0475-406c-b5ad-092bc5bf1630\" (UID: \"33ca70f3-0475-406c-b5ad-092bc5bf1630\") "
Nov 03 21:30:56.521557 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521527    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:30:56.521701 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521671    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:56.521835 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521747    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:56.521835 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.521774    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:30:56.523595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.523563    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "kube-api-access-qssxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:30:56.523595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.523574    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:56.523715 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.523631    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config" pod "33ca70f3-0475-406c-b5ad-092bc5bf1630" (UID: "33ca70f3-0475-406c-b5ad-092bc5bf1630"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:30:56.622701 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622670    6774 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:56.622701 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622698    6774 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-oauth-serving-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:56.622892 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622710    6774 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33ca70f3-0475-406c-b5ad-092bc5bf1630-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:56.622892 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622719    6774 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-oauth-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:56.622892 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622728    6774 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33ca70f3-0475-406c-b5ad-092bc5bf1630-console-serving-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:56.622892 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622737    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qssxh\" (UniqueName: \"kubernetes.io/projected/33ca70f3-0475-406c-b5ad-092bc5bf1630-kube-api-access-qssxh\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:56.622892 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:56.622745    6774 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33ca70f3-0475-406c-b5ad-092bc5bf1630-tmp\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:30:57.351847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.351808    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6c75dc87-bjqw5" event={"ID":"33ca70f3-0475-406c-b5ad-092bc5bf1630","Type":"ContainerDied","Data":"20ec2bf371bec84b7d12402fc8cd206e077a70ab9a07d0b1fdae562cc37eda87"}
Nov 03 21:30:57.351847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.351831    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6c75dc87-bjqw5"
Nov 03 21:30:57.352367 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.351879    6774 scope.go:122] "RemoveContainer" containerID="01f933042e0cc948d9822fdc92acdf93c7f1bd0d3312cd847951ea2b234b183d"
Nov 03 21:30:57.398717 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.398685    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6c75dc87-bjqw5"]
Nov 03 21:30:57.402045 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.402024    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f6c75dc87-bjqw5"]
Nov 03 21:30:57.742394 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.742313    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dfb467ff4-jlwf5"]
Nov 03 21:30:57.742649 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.742636    6774 cpu_manager.go:414] "containerMap: removing container" podUID="33ca70f3-0475-406c-b5ad-092bc5bf1630" containerName="console"
Nov 03 21:30:57.742692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.742650    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33ca70f3-0475-406c-b5ad-092bc5bf1630" containerName="console"
Nov 03 21:30:57.742723 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.742698    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="33ca70f3-0475-406c-b5ad-092bc5bf1630" containerName="console"
Nov 03 21:30:57.778659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.778630    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfb467ff4-jlwf5"]
Nov 03 21:30:57.778820 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.778746    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.831742 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831710    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.831742 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831746    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.831934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831772    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.831934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831888    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.831934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831919    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.831934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831934    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.832078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.831952    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.832078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.832036    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvs7q\" (UniqueName: \"kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933032    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933065    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933080    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933130    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvs7q\" (UniqueName: \"kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933189    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933223    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933266    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933306    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.933666 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.933644    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.934051 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.934029    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.934129 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.934029    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.934298 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.934273    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.934404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.934388    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.935853 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.935825    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.935938 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.935923    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:57.955160 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:57.955135    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvs7q\" (UniqueName: \"kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q\") pod \"console-5dfb467ff4-jlwf5\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") " pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:58.109522 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:58.109494    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:30:58.159252 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:58.159215    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33ca70f3-0475-406c-b5ad-092bc5bf1630" path="/var/lib/kubelet/pods/33ca70f3-0475-406c-b5ad-092bc5bf1630/volumes"
Nov 03 21:30:58.432822 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:58.432744    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dfb467ff4-jlwf5"]
Nov 03 21:30:58.437999 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:30:58.437972    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b15e9b_1661_4e5c_8dda_93b869965959.slice/crio-340d076907dc0ebcb99bbb89ca26730a69f7d407a54a0fe78b62de47514bf885 WatchSource:0}: Error finding container 340d076907dc0ebcb99bbb89ca26730a69f7d407a54a0fe78b62de47514bf885: Status 404 returned error can't find the container with id 340d076907dc0ebcb99bbb89ca26730a69f7d407a54a0fe78b62de47514bf885
Nov 03 21:30:59.270512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:59.270479    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qmh2m"
Nov 03 21:30:59.363547 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:59.363513    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfb467ff4-jlwf5" event={"ID":"71b15e9b-1661-4e5c-8dda-93b869965959","Type":"ContainerStarted","Data":"09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3"}
Nov 03 21:30:59.363547 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:59.363561    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfb467ff4-jlwf5" event={"ID":"71b15e9b-1661-4e5c-8dda-93b869965959","Type":"ContainerStarted","Data":"340d076907dc0ebcb99bbb89ca26730a69f7d407a54a0fe78b62de47514bf885"}
Nov 03 21:30:59.402340 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:59.402291    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5dfb467ff4-jlwf5" podStartSLOduration=2.402278795 podStartE2EDuration="2.402278795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:30:59.40196127 +0000 UTC m=+29.368798007" watchObservedRunningTime="2026-11-03 21:30:59.402278795 +0000 UTC m=+29.369115522"
Nov 03 21:30:59.837248 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:30:59.837210    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:31:01.397080 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:31:01.397045    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:31:08.110657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:08.110620    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:31:08.111121 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:08.110765    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:31:08.115276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:08.115254    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:31:08.400841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:08.400771    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:31:08.466072 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:08.466033    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468c44d4b-br6gz"]
Nov 03 21:31:31.396813 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:31:31.396776    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:31:33.486054 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.486001    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-8468c44d4b-br6gz" podUID="baac9c70-597d-4101-b1eb-aba133d57c37" containerName="console" containerID="cri-o://2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694" gracePeriod=15
Nov 03 21:31:33.728248 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.728225    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:31:33.767405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767333    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767390    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767415    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767478    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767521    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767541    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767565    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.767632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767590    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") pod \"baac9c70-597d-4101-b1eb-aba133d57c37\" (UID: \"baac9c70-597d-4101-b1eb-aba133d57c37\") "
Nov 03 21:31:33.768290 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.767948    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:31:33.768290 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.768090    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:31:33.768290 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.768241    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:31:33.768290 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.768254    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:31:33.768862 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.768568    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:31:33.770853 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.770801    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:31:33.771505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.771437    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:31:33.771625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.771508    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5" pod "baac9c70-597d-4101-b1eb-aba133d57c37" (UID: "baac9c70-597d-4101-b1eb-aba133d57c37"). InnerVolumeSpecName "kube-api-access-d9gj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:31:33.868660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868620    6774 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-trusted-ca-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868655    6774 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-console-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868668    6774 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/baac9c70-597d-4101-b1eb-aba133d57c37-tmp\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868680    6774 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-oauth-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868691    6774 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868703    6774 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/baac9c70-597d-4101-b1eb-aba133d57c37-console-serving-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868714    6774 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/baac9c70-597d-4101-b1eb-aba133d57c37-oauth-serving-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:33.868896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:33.868726    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9gj5\" (UniqueName: \"kubernetes.io/projected/baac9c70-597d-4101-b1eb-aba133d57c37-kube-api-access-d9gj5\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:31:34.493527 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.493437    6774 generic.go:356] "Generic (PLEG): container finished" podID="baac9c70-597d-4101-b1eb-aba133d57c37" containerID="2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694" exitCode=0
Nov 03 21:31:34.493527 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.493493    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8468c44d4b-br6gz"
Nov 03 21:31:34.493527 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.493509    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c44d4b-br6gz" event={"ID":"baac9c70-597d-4101-b1eb-aba133d57c37","Type":"ContainerDied","Data":"2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694"}
Nov 03 21:31:34.494012 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.493562    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8468c44d4b-br6gz" event={"ID":"baac9c70-597d-4101-b1eb-aba133d57c37","Type":"ContainerDied","Data":"e700c63716b8f172c8d1f92a7a66762eeb523b2fcb4ed597a03379af73f5d355"}
Nov 03 21:31:34.494012 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.493582    6774 scope.go:122] "RemoveContainer" containerID="2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694"
Nov 03 21:31:34.501489 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.501466    6774 scope.go:122] "RemoveContainer" containerID="2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694"
Nov 03 21:31:34.501784 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:31:34.501763    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694\": container with ID starting with 2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694 not found: ID does not exist" containerID="2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694"
Nov 03 21:31:34.501852 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.501796    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694"} err="failed to get container status \"2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694\": rpc error: code = NotFound desc = could not find container \"2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694\": container with ID starting with 2b8cb8873ebeddef1c2896246c0ac330feda79ca4aade2a39dddff5fd4dd7694 not found: ID does not exist"
Nov 03 21:31:34.542040 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.542005    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8468c44d4b-br6gz"]
Nov 03 21:31:34.554085 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:34.554056    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8468c44d4b-br6gz"]
Nov 03 21:31:36.156437 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:36.156391    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="baac9c70-597d-4101-b1eb-aba133d57c37" path="/var/lib/kubelet/pods/baac9c70-597d-4101-b1eb-aba133d57c37/volumes"
Nov 03 21:31:50.583621 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:50.583585    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:31:50.599240 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:50.599216    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:31:51.568257 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:51.568231    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Nov 03 21:31:59.499223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.499191    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-697898cdb4-ghpsn"]
Nov 03 21:31:59.499656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.499563    6774 cpu_manager.go:414] "containerMap: removing container" podUID="baac9c70-597d-4101-b1eb-aba133d57c37" containerName="console"
Nov 03 21:31:59.499656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.499579    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="baac9c70-597d-4101-b1eb-aba133d57c37" containerName="console"
Nov 03 21:31:59.499656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.499637    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="baac9c70-597d-4101-b1eb-aba133d57c37" containerName="console"
Nov 03 21:31:59.501931 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.501911    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.527115 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.527093    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697898cdb4-ghpsn"]
Nov 03 21:31:59.587855 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.587823    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zv4\" (UniqueName: \"kubernetes.io/projected/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-kube-api-access-s5zv4\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.587999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.587860    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-oauth-config\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.587999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.587884    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-oauth-serving-cert\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.588076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.588023    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-config\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.588076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.588047    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-service-ca\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.588168 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.588084    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-trusted-ca-bundle\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.588221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.588207    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-tmp\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.588276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.588255    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-serving-cert\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688683 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688650    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-serving-cert\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688699    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zv4\" (UniqueName: \"kubernetes.io/projected/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-kube-api-access-s5zv4\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688717    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-oauth-config\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688733    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-oauth-serving-cert\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688759    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-config\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688776    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-service-ca\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688795    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-trusted-ca-bundle\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.688873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.688832    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-tmp\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.689245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.689219    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-tmp\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.689648 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.689623    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-service-ca\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.689755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.689688    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-config\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.689815 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.689787    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-trusted-ca-bundle\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.689860 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.689787    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-oauth-serving-cert\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.691202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.691182    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-oauth-config\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.691347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.691330    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-console-serving-cert\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.707571 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.707552    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zv4\" (UniqueName: \"kubernetes.io/projected/13cc6919-3d3a-4722-84f6-bdc7df3b96f5-kube-api-access-s5zv4\") pod \"console-697898cdb4-ghpsn\" (UID: \"13cc6919-3d3a-4722-84f6-bdc7df3b96f5\") " pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:31:59.812016 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:31:59.811943    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:32:00.104040 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:00.104009    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697898cdb4-ghpsn"]
Nov 03 21:32:00.111148 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:32:00.111121    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13cc6919_3d3a_4722_84f6_bdc7df3b96f5.slice/crio-26861feefaa82e94d700d3750d1695e04575f4438b67aca5a33532fecce29e39 WatchSource:0}: Error finding container 26861feefaa82e94d700d3750d1695e04575f4438b67aca5a33532fecce29e39: Status 404 returned error can't find the container with id 26861feefaa82e94d700d3750d1695e04575f4438b67aca5a33532fecce29e39
Nov 03 21:32:00.588378 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:00.588280    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697898cdb4-ghpsn" event={"ID":"13cc6919-3d3a-4722-84f6-bdc7df3b96f5","Type":"ContainerStarted","Data":"49297bf44d4bb2c609ea5e0530c9b387466f0be6bcd561c588539bfdcfbe9633"}
Nov 03 21:32:00.588378 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:00.588336    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697898cdb4-ghpsn" event={"ID":"13cc6919-3d3a-4722-84f6-bdc7df3b96f5","Type":"ContainerStarted","Data":"26861feefaa82e94d700d3750d1695e04575f4438b67aca5a33532fecce29e39"}
Nov 03 21:32:00.626640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:00.626593    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-697898cdb4-ghpsn" podStartSLOduration=1.6265789750000001 podStartE2EDuration="1.626578975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:32:00.625945873 +0000 UTC m=+90.592782626" watchObservedRunningTime="2026-11-03 21:32:00.626578975 +0000 UTC m=+90.593415706"
Nov 03 21:32:01.397068 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:32:01.397025    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:32:09.813221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:09.813122    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:32:09.813221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:09.813197    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:32:09.817694 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:09.817675    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:32:10.630751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:10.630721    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-697898cdb4-ghpsn"
Nov 03 21:32:10.699809 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:10.699776    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfb467ff4-jlwf5"]
Nov 03 21:32:31.396975 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:32:31.396934    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:32:35.719647 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.719608    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5dfb467ff4-jlwf5" podUID="71b15e9b-1661-4e5c-8dda-93b869965959" containerName="console" containerID="cri-o://09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3" gracePeriod=15
Nov 03 21:32:35.958861 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.958837    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:32:35.992369 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992308    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q\" (UniqueName: \"kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992369 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992358    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp\" (UniqueName: \"kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992389    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992408    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992471    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992498    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992612    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992644    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config\") pod \"71b15e9b-1661-4e5c-8dda-93b869965959\" (UID: \"71b15e9b-1661-4e5c-8dda-93b869965959\") "
Nov 03 21:32:35.992760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992693    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:32:35.992921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992875    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:32:35.992921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992891    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:32:35.992921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.992904    6774 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71b15e9b-1661-4e5c-8dda-93b869965959-tmp\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:35.993287 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.993264    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:32:35.993371 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.993283    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:32:35.994706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.994675    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "kube-api-access-dvs7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:32:35.994793 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.994730    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:32:35.994793 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:35.994760    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config" pod "71b15e9b-1661-4e5c-8dda-93b869965959" (UID: "71b15e9b-1661-4e5c-8dda-93b869965959"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:32:36.093903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093871    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvs7q\" (UniqueName: \"kubernetes.io/projected/71b15e9b-1661-4e5c-8dda-93b869965959-kube-api-access-dvs7q\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.093903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093897    6774 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-serving-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.093903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093906    6774 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-oauth-serving-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.094164 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093916    6774 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-console-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.094164 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093924    6774 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-trusted-ca-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.094164 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093932    6774 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71b15e9b-1661-4e5c-8dda-93b869965959-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.094164 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.093941    6774 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71b15e9b-1661-4e5c-8dda-93b869965959-console-oauth-config\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:32:36.726468 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.726437    6774 generic.go:356] "Generic (PLEG): container finished" podID="71b15e9b-1661-4e5c-8dda-93b869965959" containerID="09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3" exitCode=0
Nov 03 21:32:36.726881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.726489    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dfb467ff4-jlwf5"
Nov 03 21:32:36.726881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.726515    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfb467ff4-jlwf5" event={"ID":"71b15e9b-1661-4e5c-8dda-93b869965959","Type":"ContainerDied","Data":"09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3"}
Nov 03 21:32:36.726881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.726566    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dfb467ff4-jlwf5" event={"ID":"71b15e9b-1661-4e5c-8dda-93b869965959","Type":"ContainerDied","Data":"340d076907dc0ebcb99bbb89ca26730a69f7d407a54a0fe78b62de47514bf885"}
Nov 03 21:32:36.726881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.726598    6774 scope.go:122] "RemoveContainer" containerID="09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3"
Nov 03 21:32:36.734451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.734417    6774 scope.go:122] "RemoveContainer" containerID="09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3"
Nov 03 21:32:36.734719 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:32:36.734700    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3\": container with ID starting with 09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3 not found: ID does not exist" containerID="09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3"
Nov 03 21:32:36.734788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.734729    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3"} err="failed to get container status \"09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3\": rpc error: code = NotFound desc = could not find container \"09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3\": container with ID starting with 09fc6317002fd50623551fbc247d18526b33bd2fa227c9def364c0314c4ea9a3 not found: ID does not exist"
Nov 03 21:32:36.779918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.779885    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dfb467ff4-jlwf5"]
Nov 03 21:32:36.793277 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:36.793250    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dfb467ff4-jlwf5"]
Nov 03 21:32:38.156763 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:32:38.156725    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71b15e9b-1661-4e5c-8dda-93b869965959" path="/var/lib/kubelet/pods/71b15e9b-1661-4e5c-8dda-93b869965959/volumes"
Nov 03 21:33:01.397859 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:33:01.397824    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:33:31.396926 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:33:31.396889    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:34:01.396724 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:34:01.396685    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:34:31.396741 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:34:31.396703    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:35:01.397052 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:35:01.397012    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:35:16.678414 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.678379    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"]
Nov 03 21:35:16.678976 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.678853    6774 cpu_manager.go:414] "containerMap: removing container" podUID="71b15e9b-1661-4e5c-8dda-93b869965959" containerName="console"
Nov 03 21:35:16.678976 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.678872    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71b15e9b-1661-4e5c-8dda-93b869965959" containerName="console"
Nov 03 21:35:16.678976 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.678948    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="71b15e9b-1661-4e5c-8dda-93b869965959" containerName="console"
Nov 03 21:35:16.681990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.681969    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.701285 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.701258    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.701399 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.701291    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.701467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.701402    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njdbg\" (UniqueName: \"kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.711590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.711537    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 03 21:35:16.711737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.711723    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 03 21:35:16.711898 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.711818    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-7w2nj\""
Nov 03 21:35:16.712512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.712493    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"]
Nov 03 21:35:16.801869 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.801833    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.801869 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.801866    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.802086 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.801907    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njdbg\" (UniqueName: \"kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.802229 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.802209    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.802301 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.802283    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.822997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.822964    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njdbg\" (UniqueName: \"kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:16.997215 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:16.997131    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:17.291060 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:17.290953    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"]
Nov 03 21:35:17.295015 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:35:17.294989    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe65b047_b195_48b7_baca_e18e99375ac4.slice/crio-520371582e04efc9ba573d1192bf63cf89967573815e66d31a5c477e484562f5 WatchSource:0}: Error finding container 520371582e04efc9ba573d1192bf63cf89967573815e66d31a5c477e484562f5: Status 404 returned error can't find the container with id 520371582e04efc9ba573d1192bf63cf89967573815e66d31a5c477e484562f5
Nov 03 21:35:17.297247 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:17.297231    6774 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:35:18.092239 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.092201    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"]
Nov 03 21:35:18.095671 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.095646    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.110571 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.110546    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.110720 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.110597    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.110781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.110692    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwb96\" (UniqueName: \"kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.127184 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.127153    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-gfr6x\""
Nov 03 21:35:18.128269 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.128233    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"]
Nov 03 21:35:18.172094 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.172064    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"]
Nov 03 21:35:18.175808 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.175781    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.193491 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.193461    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"]
Nov 03 21:35:18.211430 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.211385    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r2d5\" (UniqueName: \"kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.211561 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.211503    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwb96\" (UniqueName: \"kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.211611 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.211560    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.211611 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.211597    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.211695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.211621    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.211830 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.211804    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.212032 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.212010    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.212167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.212075    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.214994 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.214977    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-7tgs7\""
Nov 03 21:35:18.231931 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.231905    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwb96\" (UniqueName: \"kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.295135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.295103    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" event={"ID":"be65b047-b195-48b7-baca-e18e99375ac4","Type":"ContainerStarted","Data":"520371582e04efc9ba573d1192bf63cf89967573815e66d31a5c477e484562f5"}
Nov 03 21:35:18.312793 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.312759    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r2d5\" (UniqueName: \"kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.312975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.312848    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.312975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.312885    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.313322 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.313296    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.313462 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.313403    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.333216 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.333191    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r2d5\" (UniqueName: \"kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.413091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.413056    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:18.493458 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.493416    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:18.715310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.715247    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"]
Nov 03 21:35:18.718381 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:35:18.718354    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9afa5f_b7e9_4fe4_b3a8_acd23c73fe08.slice/crio-19a8c39dc4e9c88736d2c725d55d0dd6b37f579af2030b16e82f8d1594ce6e3a WatchSource:0}: Error finding container 19a8c39dc4e9c88736d2c725d55d0dd6b37f579af2030b16e82f8d1594ce6e3a: Status 404 returned error can't find the container with id 19a8c39dc4e9c88736d2c725d55d0dd6b37f579af2030b16e82f8d1594ce6e3a
Nov 03 21:35:18.792217 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:18.792181    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"]
Nov 03 21:35:18.796406 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:35:18.796373    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d6a39a_8cfb_4278_91a8_6540783e1c50.slice/crio-436d036d1ce88cf6153b687b3cbc548ecadeef628f57c2bdcd45d675a23f8afe WatchSource:0}: Error finding container 436d036d1ce88cf6153b687b3cbc548ecadeef628f57c2bdcd45d675a23f8afe: Status 404 returned error can't find the container with id 436d036d1ce88cf6153b687b3cbc548ecadeef628f57c2bdcd45d675a23f8afe
Nov 03 21:35:19.306917 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:19.306876    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk" event={"ID":"c7d6a39a-8cfb-4278-91a8-6540783e1c50","Type":"ContainerStarted","Data":"436d036d1ce88cf6153b687b3cbc548ecadeef628f57c2bdcd45d675a23f8afe"}
Nov 03 21:35:19.308450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:19.308406    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k" event={"ID":"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08","Type":"ContainerStarted","Data":"19a8c39dc4e9c88736d2c725d55d0dd6b37f579af2030b16e82f8d1594ce6e3a"}
Nov 03 21:35:24.336356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:24.336272    6774 generic.go:356] "Generic (PLEG): container finished" podID="be65b047-b195-48b7-baca-e18e99375ac4" containerID="c90765a33972b1b023343aa935cfbaa9d23e8a810148fab85eca1d9b22604ee7" exitCode=0
Nov 03 21:35:24.336776 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:24.336394    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" event={"ID":"be65b047-b195-48b7-baca-e18e99375ac4","Type":"ContainerDied","Data":"c90765a33972b1b023343aa935cfbaa9d23e8a810148fab85eca1d9b22604ee7"}
Nov 03 21:35:26.346847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:26.346814    6774 generic.go:356] "Generic (PLEG): container finished" podID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerID="ecc791f8c4143276453ed8f5c65235402df08a508c159d1b5ed3842b41997e09" exitCode=0
Nov 03 21:35:26.347337 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:26.346899    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk" event={"ID":"c7d6a39a-8cfb-4278-91a8-6540783e1c50","Type":"ContainerDied","Data":"ecc791f8c4143276453ed8f5c65235402df08a508c159d1b5ed3842b41997e09"}
Nov 03 21:35:26.348326 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:26.348307    6774 generic.go:356] "Generic (PLEG): container finished" podID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerID="623f1b175e5549133e209fa095d7de5b4fa7b6e89d66df104acea422eb38a954" exitCode=0
Nov 03 21:35:26.348412 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:26.348385    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k" event={"ID":"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08","Type":"ContainerDied","Data":"623f1b175e5549133e209fa095d7de5b4fa7b6e89d66df104acea422eb38a954"}
Nov 03 21:35:27.353698 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:27.353623    6774 generic.go:356] "Generic (PLEG): container finished" podID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerID="a4f8397b44bb83e11cb20cf74a354406093ecc34cb4415e88f9e2ee022249357" exitCode=0
Nov 03 21:35:27.354082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:27.353698    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k" event={"ID":"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08","Type":"ContainerDied","Data":"a4f8397b44bb83e11cb20cf74a354406093ecc34cb4415e88f9e2ee022249357"}
Nov 03 21:35:27.355628 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:27.355611    6774 generic.go:356] "Generic (PLEG): container finished" podID="be65b047-b195-48b7-baca-e18e99375ac4" containerID="68564143567aad6b0d30f0dc533d226d7fd30d7d6835c916daef31ecb005dce7" exitCode=0
Nov 03 21:35:27.355700 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:27.355671    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" event={"ID":"be65b047-b195-48b7-baca-e18e99375ac4","Type":"ContainerDied","Data":"68564143567aad6b0d30f0dc533d226d7fd30d7d6835c916daef31ecb005dce7"}
Nov 03 21:35:27.357585 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:27.357561    6774 generic.go:356] "Generic (PLEG): container finished" podID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerID="cad780d00fdf7bc9ba990c45dc4a9637c1d345d568f9b0f438b876924483612e" exitCode=0
Nov 03 21:35:27.357672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:27.357620    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk" event={"ID":"c7d6a39a-8cfb-4278-91a8-6540783e1c50","Type":"ContainerDied","Data":"cad780d00fdf7bc9ba990c45dc4a9637c1d345d568f9b0f438b876924483612e"}
Nov 03 21:35:31.407558 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:35:31.407511    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:35:35.400212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:35.400177    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" event={"ID":"be65b047-b195-48b7-baca-e18e99375ac4","Type":"ContainerStarted","Data":"ace01a6e8af419c00e583079d4a8aaea6e61307d42c34acb713986a49acd938a"}
Nov 03 21:35:35.402529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:35.402461    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk" event={"ID":"c7d6a39a-8cfb-4278-91a8-6540783e1c50","Type":"ContainerStarted","Data":"0cf7c606416dbdf4305f99d63ca2f8b746ea047a0ccfa19d017955ee7a24c39f"}
Nov 03 21:35:35.404343 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:35.404321    6774 generic.go:356] "Generic (PLEG): container finished" podID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerID="9409d4ab15f33f75751d2c1b76df8e07d635a8d25d1a867cb8ad451c68ea7e29" exitCode=0
Nov 03 21:35:35.404448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:35.404356    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k" event={"ID":"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08","Type":"ContainerDied","Data":"9409d4ab15f33f75751d2c1b76df8e07d635a8d25d1a867cb8ad451c68ea7e29"}
Nov 03 21:35:35.441519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:35.441476    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" podStartSLOduration=2.946509362 podStartE2EDuration="19.44146321s" totalImagesPullingTime="16.494953848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:35:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:35:35.440806774 +0000 UTC m=+305.407643508" watchObservedRunningTime="2026-11-03 21:35:35.44146321 +0000 UTC m=+305.408299931"
Nov 03 21:35:36.410767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.410674    6774 generic.go:356] "Generic (PLEG): container finished" podID="be65b047-b195-48b7-baca-e18e99375ac4" containerID="ace01a6e8af419c00e583079d4a8aaea6e61307d42c34acb713986a49acd938a" exitCode=0
Nov 03 21:35:36.410767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.410708    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" event={"ID":"be65b047-b195-48b7-baca-e18e99375ac4","Type":"ContainerDied","Data":"ace01a6e8af419c00e583079d4a8aaea6e61307d42c34acb713986a49acd938a"}
Nov 03 21:35:36.412811 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.412788    6774 generic.go:356] "Generic (PLEG): container finished" podID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerID="0cf7c606416dbdf4305f99d63ca2f8b746ea047a0ccfa19d017955ee7a24c39f" exitCode=0
Nov 03 21:35:36.412960 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.412876    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk" event={"ID":"c7d6a39a-8cfb-4278-91a8-6540783e1c50","Type":"ContainerDied","Data":"0cf7c606416dbdf4305f99d63ca2f8b746ea047a0ccfa19d017955ee7a24c39f"}
Nov 03 21:35:36.558875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.558847    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:36.561809 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.561787    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:36.692330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692244    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util\") pod \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") "
Nov 03 21:35:36.692330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692305    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util\") pod \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") "
Nov 03 21:35:36.692330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692325    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96\" (UniqueName: \"kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96\") pod \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") "
Nov 03 21:35:36.692689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692358    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle\") pod \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\" (UID: \"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08\") "
Nov 03 21:35:36.692689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692592    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5\" (UniqueName: \"kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5\") pod \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") "
Nov 03 21:35:36.692689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692643    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle\") pod \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\" (UID: \"c7d6a39a-8cfb-4278-91a8-6540783e1c50\") "
Nov 03 21:35:36.692884 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.692857    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle" pod "0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" (UID: "0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:35:36.693546 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.693503    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle" pod "c7d6a39a-8cfb-4278-91a8-6540783e1c50" (UID: "c7d6a39a-8cfb-4278-91a8-6540783e1c50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:35:36.694735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.694711    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5" pod "c7d6a39a-8cfb-4278-91a8-6540783e1c50" (UID: "c7d6a39a-8cfb-4278-91a8-6540783e1c50"). InnerVolumeSpecName "kube-api-access-7r2d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:35:36.694845 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.694766    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96" pod "0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" (UID: "0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08"). InnerVolumeSpecName "kube-api-access-vwb96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:35:36.696813 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.696791    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util" pod "c7d6a39a-8cfb-4278-91a8-6540783e1c50" (UID: "c7d6a39a-8cfb-4278-91a8-6540783e1c50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:35:36.698449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.698408    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util" pod "0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" (UID: "0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:35:36.793399 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.793362    6774 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-util\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:36.793399 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.793392    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwb96\" (UniqueName: \"kubernetes.io/projected/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-kube-api-access-vwb96\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:36.793399 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.793404    6774 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:36.793645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.793412    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r2d5\" (UniqueName: \"kubernetes.io/projected/c7d6a39a-8cfb-4278-91a8-6540783e1c50-kube-api-access-7r2d5\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:36.793645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.793438    6774 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:36.793645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:36.793446    6774 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c7d6a39a-8cfb-4278-91a8-6540783e1c50-util\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:37.418179 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.418151    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk"
Nov 03 21:35:37.418179 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.418161    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajb4qk" event={"ID":"c7d6a39a-8cfb-4278-91a8-6540783e1c50","Type":"ContainerDied","Data":"436d036d1ce88cf6153b687b3cbc548ecadeef628f57c2bdcd45d675a23f8afe"}
Nov 03 21:35:37.418735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.418203    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="436d036d1ce88cf6153b687b3cbc548ecadeef628f57c2bdcd45d675a23f8afe"
Nov 03 21:35:37.420207 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.420184    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k"
Nov 03 21:35:37.420207 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.420193    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6fw87k" event={"ID":"0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08","Type":"ContainerDied","Data":"19a8c39dc4e9c88736d2c725d55d0dd6b37f579af2030b16e82f8d1594ce6e3a"}
Nov 03 21:35:37.420403 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.420233    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19a8c39dc4e9c88736d2c725d55d0dd6b37f579af2030b16e82f8d1594ce6e3a"
Nov 03 21:35:37.548378 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.548350    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:37.701550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.701457    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg\" (UniqueName: \"kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg\") pod \"be65b047-b195-48b7-baca-e18e99375ac4\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") "
Nov 03 21:35:37.701550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.701536    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle\") pod \"be65b047-b195-48b7-baca-e18e99375ac4\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") "
Nov 03 21:35:37.701759 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.701641    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util\") pod \"be65b047-b195-48b7-baca-e18e99375ac4\" (UID: \"be65b047-b195-48b7-baca-e18e99375ac4\") "
Nov 03 21:35:37.702346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.702316    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle" pod "be65b047-b195-48b7-baca-e18e99375ac4" (UID: "be65b047-b195-48b7-baca-e18e99375ac4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:35:37.703622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.703599    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg" pod "be65b047-b195-48b7-baca-e18e99375ac4" (UID: "be65b047-b195-48b7-baca-e18e99375ac4"). InnerVolumeSpecName "kube-api-access-njdbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:35:37.707041 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.707020    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util" pod "be65b047-b195-48b7-baca-e18e99375ac4" (UID: "be65b047-b195-48b7-baca-e18e99375ac4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:35:37.803187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.803145    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njdbg\" (UniqueName: \"kubernetes.io/projected/be65b047-b195-48b7-baca-e18e99375ac4-kube-api-access-njdbg\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:37.803187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.803179    6774 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-bundle\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:37.803187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:37.803193    6774 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be65b047-b195-48b7-baca-e18e99375ac4-util\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:35:38.426095 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:38.426009    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk" event={"ID":"be65b047-b195-48b7-baca-e18e99375ac4","Type":"ContainerDied","Data":"520371582e04efc9ba573d1192bf63cf89967573815e66d31a5c477e484562f5"}
Nov 03 21:35:38.426095 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:38.426060    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="520371582e04efc9ba573d1192bf63cf89967573815e66d31a5c477e484562f5"
Nov 03 21:35:38.426095 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:38.426017    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c4nxtk"
Nov 03 21:35:44.383821 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.383787    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"]
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384077    6774 cpu_manager.go:414] "containerMap: removing container" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="extract"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384087    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="extract"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384098    6774 cpu_manager.go:414] "containerMap: removing container" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="pull"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384102    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="pull"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384121    6774 cpu_manager.go:414] "containerMap: removing container" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="pull"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384126    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="pull"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384137    6774 cpu_manager.go:414] "containerMap: removing container" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="util"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384143    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="util"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384150    6774 cpu_manager.go:414] "containerMap: removing container" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="util"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384154    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="util"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384164    6774 cpu_manager.go:414] "containerMap: removing container" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="extract"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384168    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="extract"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384175    6774 cpu_manager.go:414] "containerMap: removing container" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="util"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384180    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="util"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384185    6774 cpu_manager.go:414] "containerMap: removing container" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="pull"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384190    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="pull"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384198    6774 cpu_manager.go:414] "containerMap: removing container" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="extract"
Nov 03 21:35:44.384202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384202    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="extract"
Nov 03 21:35:44.384735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384244    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f9afa5f-b7e9-4fe4-b3a8-acd23c73fe08" containerName="extract"
Nov 03 21:35:44.384735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384252    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="be65b047-b195-48b7-baca-e18e99375ac4" containerName="extract"
Nov 03 21:35:44.384735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.384262    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7d6a39a-8cfb-4278-91a8-6540783e1c50" containerName="extract"
Nov 03 21:35:44.410404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.410379    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"]
Nov 03 21:35:44.410580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.410511    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.427415 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.427388    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:35:44.427415 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.427403    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 03 21:35:44.427649 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.427562    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tzqf6\""
Nov 03 21:35:44.559019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.558981    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnc9\" (UniqueName: \"kubernetes.io/projected/746b6418-db53-4f71-ac82-0e501b58f6b3-kube-api-access-5vnc9\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj\" (UID: \"746b6418-db53-4f71-ac82-0e501b58f6b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.559209 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.559044    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/746b6418-db53-4f71-ac82-0e501b58f6b3-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj\" (UID: \"746b6418-db53-4f71-ac82-0e501b58f6b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.660248 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.660156    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/746b6418-db53-4f71-ac82-0e501b58f6b3-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj\" (UID: \"746b6418-db53-4f71-ac82-0e501b58f6b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.660385 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.660247    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnc9\" (UniqueName: \"kubernetes.io/projected/746b6418-db53-4f71-ac82-0e501b58f6b3-kube-api-access-5vnc9\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj\" (UID: \"746b6418-db53-4f71-ac82-0e501b58f6b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.660578 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.660559    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/746b6418-db53-4f71-ac82-0e501b58f6b3-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj\" (UID: \"746b6418-db53-4f71-ac82-0e501b58f6b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.680791 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.680765    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnc9\" (UniqueName: \"kubernetes.io/projected/746b6418-db53-4f71-ac82-0e501b58f6b3-kube-api-access-5vnc9\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj\" (UID: \"746b6418-db53-4f71-ac82-0e501b58f6b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:44.729722 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:44.729684    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"
Nov 03 21:35:45.070738 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:45.070484    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj"]
Nov 03 21:35:45.073663 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:35:45.073631    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746b6418_db53_4f71_ac82_0e501b58f6b3.slice/crio-f45537d17bfcc78bb235871a36f2ccf55e69c876042491515545a1a78a724f84 WatchSource:0}: Error finding container f45537d17bfcc78bb235871a36f2ccf55e69c876042491515545a1a78a724f84: Status 404 returned error can't find the container with id f45537d17bfcc78bb235871a36f2ccf55e69c876042491515545a1a78a724f84
Nov 03 21:35:45.455635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:45.455602    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj" event={"ID":"746b6418-db53-4f71-ac82-0e501b58f6b3","Type":"ContainerStarted","Data":"f45537d17bfcc78bb235871a36f2ccf55e69c876042491515545a1a78a724f84"}
Nov 03 21:35:47.471505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:47.471471    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj" event={"ID":"746b6418-db53-4f71-ac82-0e501b58f6b3","Type":"ContainerStarted","Data":"6a17dc6d5df20ae92a488029063bb0d72a5ad7434f531e71a1b4be3a95937a44"}
Nov 03 21:35:47.545798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:47.545739    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-dkbzj" podStartSLOduration=2.043196852 podStartE2EDuration="3.545725764s" totalImagesPullingTime="1.502528912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:35:47.531848591 +0000 UTC m=+317.498685388" watchObservedRunningTime="2026-11-03 21:35:47.545725764 +0000 UTC m=+317.512562497"
Nov 03 21:35:49.486145 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.486114    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"]
Nov 03 21:35:49.488338 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.488321    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.519584 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.519538    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Nov 03 21:35:49.519719 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.519651    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Nov 03 21:35:49.519719 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.519656    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4vnd7\""
Nov 03 21:35:49.521111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.521093    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"]
Nov 03 21:35:49.604187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.604152    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgvj5\" (UniqueName: \"kubernetes.io/projected/66aefade-c112-4b2e-8f5a-bfcfb028369f-kube-api-access-zgvj5\") pod \"cert-manager-webhook-5dbbbf75cc-v8hgl\" (UID: \"66aefade-c112-4b2e-8f5a-bfcfb028369f\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.604187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.604187    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66aefade-c112-4b2e-8f5a-bfcfb028369f-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-v8hgl\" (UID: \"66aefade-c112-4b2e-8f5a-bfcfb028369f\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.705819 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.705778    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgvj5\" (UniqueName: \"kubernetes.io/projected/66aefade-c112-4b2e-8f5a-bfcfb028369f-kube-api-access-zgvj5\") pod \"cert-manager-webhook-5dbbbf75cc-v8hgl\" (UID: \"66aefade-c112-4b2e-8f5a-bfcfb028369f\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.705819 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.705818    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66aefade-c112-4b2e-8f5a-bfcfb028369f-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-v8hgl\" (UID: \"66aefade-c112-4b2e-8f5a-bfcfb028369f\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.728168 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.728137    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/66aefade-c112-4b2e-8f5a-bfcfb028369f-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-v8hgl\" (UID: \"66aefade-c112-4b2e-8f5a-bfcfb028369f\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.728437 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.728401    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgvj5\" (UniqueName: \"kubernetes.io/projected/66aefade-c112-4b2e-8f5a-bfcfb028369f-kube-api-access-zgvj5\") pod \"cert-manager-webhook-5dbbbf75cc-v8hgl\" (UID: \"66aefade-c112-4b2e-8f5a-bfcfb028369f\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:49.816660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:49.816544    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:50.109600 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:50.109563    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"]
Nov 03 21:35:50.112343 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:35:50.112320    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66aefade_c112_4b2e_8f5a_bfcfb028369f.slice/crio-70c900dd9e2423964a761c10baae931fff70b206b6dddbda5f262d6c784d7392 WatchSource:0}: Error finding container 70c900dd9e2423964a761c10baae931fff70b206b6dddbda5f262d6c784d7392: Status 404 returned error can't find the container with id 70c900dd9e2423964a761c10baae931fff70b206b6dddbda5f262d6c784d7392
Nov 03 21:35:50.484875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:50.484788    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl" event={"ID":"66aefade-c112-4b2e-8f5a-bfcfb028369f","Type":"ContainerStarted","Data":"70c900dd9e2423964a761c10baae931fff70b206b6dddbda5f262d6c784d7392"}
Nov 03 21:35:53.498565 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:53.498528    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl" event={"ID":"66aefade-c112-4b2e-8f5a-bfcfb028369f","Type":"ContainerStarted","Data":"15dab525a8107604b44894c5c02fdc8d6a0c9c7a157efb0e553802a61f1d8204"}
Nov 03 21:35:53.499059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:53.498600    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:53.539045 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:53.538994    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl" podStartSLOduration=1.332211249 podStartE2EDuration="4.538979444s" totalImagesPullingTime="3.206768195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:35:53.537789128 +0000 UTC m=+323.504625875" watchObservedRunningTime="2026-11-03 21:35:53.538979444 +0000 UTC m=+323.505816178"
Nov 03 21:35:56.482388 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.482354    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"]
Nov 03 21:35:56.484713 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.484697    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.504730 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.504704    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"]
Nov 03 21:35:56.514300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.514283    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tnl6q\""
Nov 03 21:35:56.662296 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.662265    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjq8\" (UniqueName: \"kubernetes.io/projected/4a92aefa-b64d-48ab-a776-103d7d231a5f-kube-api-access-bxjq8\") pod \"cert-manager-cainjector-5c57bbd4fc-gkfg8\" (UID: \"4a92aefa-b64d-48ab-a776-103d7d231a5f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.662512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.662387    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a92aefa-b64d-48ab-a776-103d7d231a5f-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-gkfg8\" (UID: \"4a92aefa-b64d-48ab-a776-103d7d231a5f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.763965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.763890    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjq8\" (UniqueName: \"kubernetes.io/projected/4a92aefa-b64d-48ab-a776-103d7d231a5f-kube-api-access-bxjq8\") pod \"cert-manager-cainjector-5c57bbd4fc-gkfg8\" (UID: \"4a92aefa-b64d-48ab-a776-103d7d231a5f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.763965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.763941    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a92aefa-b64d-48ab-a776-103d7d231a5f-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-gkfg8\" (UID: \"4a92aefa-b64d-48ab-a776-103d7d231a5f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.784237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.784199    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a92aefa-b64d-48ab-a776-103d7d231a5f-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-gkfg8\" (UID: \"4a92aefa-b64d-48ab-a776-103d7d231a5f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.784367 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.784339    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjq8\" (UniqueName: \"kubernetes.io/projected/4a92aefa-b64d-48ab-a776-103d7d231a5f-kube-api-access-bxjq8\") pod \"cert-manager-cainjector-5c57bbd4fc-gkfg8\" (UID: \"4a92aefa-b64d-48ab-a776-103d7d231a5f\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:56.795038 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:56.795017    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"
Nov 03 21:35:57.095979 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:57.095950    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8"]
Nov 03 21:35:57.099056 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:35:57.099033    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a92aefa_b64d_48ab_a776_103d7d231a5f.slice/crio-a9198c6940263b64f47a229bc1659e59aea35b76717afd66df0201e896b3640d WatchSource:0}: Error finding container a9198c6940263b64f47a229bc1659e59aea35b76717afd66df0201e896b3640d: Status 404 returned error can't find the container with id a9198c6940263b64f47a229bc1659e59aea35b76717afd66df0201e896b3640d
Nov 03 21:35:57.517898 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:57.517808    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8" event={"ID":"4a92aefa-b64d-48ab-a776-103d7d231a5f","Type":"ContainerStarted","Data":"c2cdfacdfb535b129ec9a7133b78aa65f261e1d10e8e3b5aecdd5d5f0e5f1f72"}
Nov 03 21:35:57.517898 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:57.517850    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8" event={"ID":"4a92aefa-b64d-48ab-a776-103d7d231a5f","Type":"ContainerStarted","Data":"a9198c6940263b64f47a229bc1659e59aea35b76717afd66df0201e896b3640d"}
Nov 03 21:35:59.504984 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:59.504949    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-v8hgl"
Nov 03 21:35:59.545650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:35:59.545598    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-gkfg8" podStartSLOduration=3.545584444 podStartE2EDuration="3.545584444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:35:57.558621085 +0000 UTC m=+327.525457820" watchObservedRunningTime="2026-11-03 21:35:59.545584444 +0000 UTC m=+329.512421178"
Nov 03 21:36:01.397875 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:36:01.397837    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:36:04.248900 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.248869    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"]
Nov 03 21:36:04.251326 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.251309    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.291978 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.291946    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"]
Nov 03 21:36:04.322317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.322281    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-webhook-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.322317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.322317    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-metrics-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.322610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.322354    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3243b379-2dec-48a8-aa71-d6d816019672-manifests\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.322610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.322561    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.322610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.322597    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3243b379-2dec-48a8-aa71-d6d816019672-tmp\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.322710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.322621    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2cls\" (UniqueName: \"kubernetes.io/projected/3243b379-2dec-48a8-aa71-d6d816019672-kube-api-access-l2cls\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.347138 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.347110    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 03 21:36:04.347261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.347168    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 03 21:36:04.347308 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.347294    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 03 21:36:04.347454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.347415    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-zrtwp\""
Nov 03 21:36:04.347542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.347526    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 03 21:36:04.347576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.347561    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 03 21:36:04.423757 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.423719    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2cls\" (UniqueName: \"kubernetes.io/projected/3243b379-2dec-48a8-aa71-d6d816019672-kube-api-access-l2cls\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.423939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.423776    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-webhook-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.423939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.423799    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-metrics-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.423939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.423822    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3243b379-2dec-48a8-aa71-d6d816019672-manifests\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.423939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.423869    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.423939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.423901    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3243b379-2dec-48a8-aa71-d6d816019672-tmp\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.424329 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.424302    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3243b379-2dec-48a8-aa71-d6d816019672-manifests\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.426997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.426970    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.427191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.426970    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3243b379-2dec-48a8-aa71-d6d816019672-tmp\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.427191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.427061    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-webhook-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.427191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.427138    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3243b379-2dec-48a8-aa71-d6d816019672-metrics-cert\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.456756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.456715    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2cls\" (UniqueName: \"kubernetes.io/projected/3243b379-2dec-48a8-aa71-d6d816019672-kube-api-access-l2cls\") pod \"opendatahub-operator-controller-manager-5754f75c9f-k8spj\" (UID: \"3243b379-2dec-48a8-aa71-d6d816019672\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.563883 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.563802    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:04.906786 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:04.906729    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"]
Nov 03 21:36:04.909140 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:04.909115    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3243b379_2dec_48a8_aa71_d6d816019672.slice/crio-d547e5fa759400d9caf01b77d88bcbbb37a2b55acc6675cce19e4bb7a31339e6 WatchSource:0}: Error finding container d547e5fa759400d9caf01b77d88bcbbb37a2b55acc6675cce19e4bb7a31339e6: Status 404 returned error can't find the container with id d547e5fa759400d9caf01b77d88bcbbb37a2b55acc6675cce19e4bb7a31339e6
Nov 03 21:36:05.563223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:05.563181    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj" event={"ID":"3243b379-2dec-48a8-aa71-d6d816019672","Type":"ContainerStarted","Data":"d547e5fa759400d9caf01b77d88bcbbb37a2b55acc6675cce19e4bb7a31339e6"}
Nov 03 21:36:08.577938 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:08.577848    6774 generic.go:356] "Generic (PLEG): container finished" podID="3243b379-2dec-48a8-aa71-d6d816019672" containerID="7f835d1c0ff4e9aea4559a0064f074486d685df37ee2d097e3a6d61ceb15c90c" exitCode=0
Nov 03 21:36:08.578374 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:08.577932    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj" event={"ID":"3243b379-2dec-48a8-aa71-d6d816019672","Type":"ContainerDied","Data":"7f835d1c0ff4e9aea4559a0064f074486d685df37ee2d097e3a6d61ceb15c90c"}
Nov 03 21:36:09.584196 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:09.584161    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj" event={"ID":"3243b379-2dec-48a8-aa71-d6d816019672","Type":"ContainerStarted","Data":"00e00900ea7f6cef88f218425fa871735610d50f5d8825e0b6646b138f57f92a"}
Nov 03 21:36:09.584618 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:09.584259    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:09.674274 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:09.674218    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj" podStartSLOduration=2.192769821 podStartE2EDuration="5.674204576s" totalImagesPullingTime="3.071134328s" totalInitContainerRuntime="410.300427ms" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:09.660288318 +0000 UTC m=+339.627125066" watchObservedRunningTime="2026-11-03 21:36:09.674204576 +0000 UTC m=+339.641041310"
Nov 03 21:36:13.564867 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.564836    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"]
Nov 03 21:36:13.571270 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.571255    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.585737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.585711    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"]
Nov 03 21:36:13.598286 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.598265    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 03 21:36:13.598286 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.598265    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Nov 03 21:36:13.598456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.598290    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 03 21:36:13.598456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.598293    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Nov 03 21:36:13.602212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.602192    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8725e8dd-b62b-419c-bc7a-1d00064b90e3-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.602301 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.602223    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9sxd\" (UniqueName: \"kubernetes.io/projected/8725e8dd-b62b-419c-bc7a-1d00064b90e3-kube-api-access-n9sxd\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.602301 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.602263    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8725e8dd-b62b-419c-bc7a-1d00064b90e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.603267 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.603249    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4sgwz\""
Nov 03 21:36:13.703630 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.703591    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8725e8dd-b62b-419c-bc7a-1d00064b90e3-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.703630 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.703633    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9sxd\" (UniqueName: \"kubernetes.io/projected/8725e8dd-b62b-419c-bc7a-1d00064b90e3-kube-api-access-n9sxd\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.703904 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.703678    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8725e8dd-b62b-419c-bc7a-1d00064b90e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.704269 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.704246    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8725e8dd-b62b-419c-bc7a-1d00064b90e3-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.706098 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.706063    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8725e8dd-b62b-419c-bc7a-1d00064b90e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.727232 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.727206    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9sxd\" (UniqueName: \"kubernetes.io/projected/8725e8dd-b62b-419c-bc7a-1d00064b90e3-kube-api-access-n9sxd\") pod \"kuadrant-console-plugin-66c4fb575d-kvkcj\" (UID: \"8725e8dd-b62b-419c-bc7a-1d00064b90e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:13.882340 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:13.882307    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"
Nov 03 21:36:14.173800 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.173728    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj"]
Nov 03 21:36:14.176957 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:14.176928    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8725e8dd_b62b_419c_bc7a_1d00064b90e3.slice/crio-bf5417b66965db677c9f7d2bfd0e0e057e395e9aee9ec353538dc2c4a3f6ea1f WatchSource:0}: Error finding container bf5417b66965db677c9f7d2bfd0e0e057e395e9aee9ec353538dc2c4a3f6ea1f: Status 404 returned error can't find the container with id bf5417b66965db677c9f7d2bfd0e0e057e395e9aee9ec353538dc2c4a3f6ea1f
Nov 03 21:36:14.277746 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.277711    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"]
Nov 03 21:36:14.282551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.282531    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.302802 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.302764    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-wpbqx\""
Nov 03 21:36:14.309011 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.308987    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06606747-ee8b-4845-aef8-44fbd9474570-tmp\") pod \"jobset-operator-674cd59dc5-pxc4d\" (UID: \"06606747-ee8b-4845-aef8-44fbd9474570\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.309138 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.309024    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxp6r\" (UniqueName: \"kubernetes.io/projected/06606747-ee8b-4845-aef8-44fbd9474570-kube-api-access-sxp6r\") pod \"jobset-operator-674cd59dc5-pxc4d\" (UID: \"06606747-ee8b-4845-aef8-44fbd9474570\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.316409 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.316389    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 03 21:36:14.316537 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.316516    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 03 21:36:14.317429 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.317400    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"]
Nov 03 21:36:14.410051 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.410017    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06606747-ee8b-4845-aef8-44fbd9474570-tmp\") pod \"jobset-operator-674cd59dc5-pxc4d\" (UID: \"06606747-ee8b-4845-aef8-44fbd9474570\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.410225 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.410057    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxp6r\" (UniqueName: \"kubernetes.io/projected/06606747-ee8b-4845-aef8-44fbd9474570-kube-api-access-sxp6r\") pod \"jobset-operator-674cd59dc5-pxc4d\" (UID: \"06606747-ee8b-4845-aef8-44fbd9474570\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.410499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.410483    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06606747-ee8b-4845-aef8-44fbd9474570-tmp\") pod \"jobset-operator-674cd59dc5-pxc4d\" (UID: \"06606747-ee8b-4845-aef8-44fbd9474570\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.436436 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.436367    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxp6r\" (UniqueName: \"kubernetes.io/projected/06606747-ee8b-4845-aef8-44fbd9474570-kube-api-access-sxp6r\") pod \"jobset-operator-674cd59dc5-pxc4d\" (UID: \"06606747-ee8b-4845-aef8-44fbd9474570\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.593782 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.593746    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"
Nov 03 21:36:14.609008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.608972    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj" event={"ID":"8725e8dd-b62b-419c-bc7a-1d00064b90e3","Type":"ContainerStarted","Data":"bf5417b66965db677c9f7d2bfd0e0e057e395e9aee9ec353538dc2c4a3f6ea1f"}
Nov 03 21:36:14.895796 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:14.895532    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d"]
Nov 03 21:36:14.898270 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:14.898230    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06606747_ee8b_4845_aef8_44fbd9474570.slice/crio-05e981bf7d26f2e7e24781aa4d19aa9b6360212a50a505910c3533ecd94d43cd WatchSource:0}: Error finding container 05e981bf7d26f2e7e24781aa4d19aa9b6360212a50a505910c3533ecd94d43cd: Status 404 returned error can't find the container with id 05e981bf7d26f2e7e24781aa4d19aa9b6360212a50a505910c3533ecd94d43cd
Nov 03 21:36:15.614783 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:15.614748    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d" event={"ID":"06606747-ee8b-4845-aef8-44fbd9474570","Type":"ContainerStarted","Data":"05e981bf7d26f2e7e24781aa4d19aa9b6360212a50a505910c3533ecd94d43cd"}
Nov 03 21:36:18.638802 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:18.638758    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d" event={"ID":"06606747-ee8b-4845-aef8-44fbd9474570","Type":"ContainerStarted","Data":"efc9607e49e62ad48d6d6765a58be545534edc1c224e15f2991b40ed33770a51"}
Nov 03 21:36:18.686028 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:18.685958    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-pxc4d" podStartSLOduration=1.571087043 podStartE2EDuration="4.68593827s" totalImagesPullingTime="3.114851227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:18.684743958 +0000 UTC m=+348.651580703" watchObservedRunningTime="2026-11-03 21:36:18.68593827 +0000 UTC m=+348.652775005"
Nov 03 21:36:19.644911 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:19.644865    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj" event={"ID":"8725e8dd-b62b-419c-bc7a-1d00064b90e3","Type":"ContainerStarted","Data":"3abe851f9ac52580ae1dbbf2e97f593008a2133e5484662c8e028f2fe7914eb6"}
Nov 03 21:36:19.684812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:19.684750    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kvkcj" podStartSLOduration=1.53248724 podStartE2EDuration="6.684733074s" totalImagesPullingTime="5.152245834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:19.684366775 +0000 UTC m=+349.651203508" watchObservedRunningTime="2026-11-03 21:36:19.684733074 +0000 UTC m=+349.651569807"
Nov 03 21:36:20.590729 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:20.590699    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5754f75c9f-k8spj"
Nov 03 21:36:31.397445 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:36:31.397391    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:36:31.775351 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.775268    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"]
Nov 03 21:36:31.780344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.780326    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.810372 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.810342    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 03 21:36:31.810561 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.810396    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kck8n\""
Nov 03 21:36:31.810561 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.810471    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 03 21:36:31.810561 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.810525    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 03 21:36:31.810682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.810657    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 03 21:36:31.813434 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.813402    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"]
Nov 03 21:36:31.865501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.865471    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zm7\" (UniqueName: \"kubernetes.io/projected/125ee10d-14b2-45cb-82cd-f52babe26bf9-kube-api-access-74zm7\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.865671 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.865516    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/125ee10d-14b2-45cb-82cd-f52babe26bf9-tmp\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.865671 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.865611    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125ee10d-14b2-45cb-82cd-f52babe26bf9-tls-certs\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.967085 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.967044    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zm7\" (UniqueName: \"kubernetes.io/projected/125ee10d-14b2-45cb-82cd-f52babe26bf9-kube-api-access-74zm7\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.967279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.967102    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/125ee10d-14b2-45cb-82cd-f52babe26bf9-tmp\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.967279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.967134    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125ee10d-14b2-45cb-82cd-f52babe26bf9-tls-certs\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.969344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.969319    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/125ee10d-14b2-45cb-82cd-f52babe26bf9-tmp\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.969667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.969649    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125ee10d-14b2-45cb-82cd-f52babe26bf9-tls-certs\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:31.999137 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:31.999105    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zm7\" (UniqueName: \"kubernetes.io/projected/125ee10d-14b2-45cb-82cd-f52babe26bf9-kube-api-access-74zm7\") pod \"kube-auth-proxy-6b5554b6f8-x5m6g\" (UID: \"125ee10d-14b2-45cb-82cd-f52babe26bf9\") " pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:32.094628 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:32.094545    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"
Nov 03 21:36:32.390493 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:32.390470    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g"]
Nov 03 21:36:32.393009 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:32.392976    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125ee10d_14b2_45cb_82cd_f52babe26bf9.slice/crio-e211b2ccac6508cd87c25b48b1e37835b38f1e503514e11208e39c103b3a55f6 WatchSource:0}: Error finding container e211b2ccac6508cd87c25b48b1e37835b38f1e503514e11208e39c103b3a55f6: Status 404 returned error can't find the container with id e211b2ccac6508cd87c25b48b1e37835b38f1e503514e11208e39c103b3a55f6
Nov 03 21:36:32.702552 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:32.702462    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g" event={"ID":"125ee10d-14b2-45cb-82cd-f52babe26bf9","Type":"ContainerStarted","Data":"e211b2ccac6508cd87c25b48b1e37835b38f1e503514e11208e39c103b3a55f6"}
Nov 03 21:36:33.189058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.189020    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:33.192777 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.192746    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.219789 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.219757    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:33.228974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.228946    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Nov 03 21:36:33.279999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.279807    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7vlt\" (UniqueName: \"kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt\") pod \"limitador-limitador-74dfcfb894-fz5ft\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.279999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.279898    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file\") pod \"limitador-limitador-74dfcfb894-fz5ft\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.328392 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.328309    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:33.380617 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.380582    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file\") pod \"limitador-limitador-74dfcfb894-fz5ft\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.380865 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.380668    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7vlt\" (UniqueName: \"kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt\") pod \"limitador-limitador-74dfcfb894-fz5ft\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.381382 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.381350    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file\") pod \"limitador-limitador-74dfcfb894-fz5ft\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.412113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.412077    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7vlt\" (UniqueName: \"kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt\") pod \"limitador-limitador-74dfcfb894-fz5ft\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.508196 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.508119    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:33.814070 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:33.813995    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:33.817475 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:33.817445    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1ca5c3_54c2_4547_a05f_fc19f08984b2.slice/crio-6b90854290e02687719d9284ca229d65864b0820bafca91c6497a65a875a42b3 WatchSource:0}: Error finding container 6b90854290e02687719d9284ca229d65864b0820bafca91c6497a65a875a42b3: Status 404 returned error can't find the container with id 6b90854290e02687719d9284ca229d65864b0820bafca91c6497a65a875a42b3
Nov 03 21:36:34.686613 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.686571    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5ldzt"]
Nov 03 21:36:34.690812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.690785    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:36:34.708854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.708823    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5ldzt"]
Nov 03 21:36:34.713374 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.713311    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft" event={"ID":"3e1ca5c3-54c2-4547-a05f-fc19f08984b2","Type":"ContainerStarted","Data":"6b90854290e02687719d9284ca229d65864b0820bafca91c6497a65a875a42b3"}
Nov 03 21:36:34.720898 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.720878    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nhc5f\""
Nov 03 21:36:34.791825 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.791801    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvzg\" (UniqueName: \"kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg\") pod \"authorino-56c6c9ddd5-5ldzt\" (UID: \"53cd289f-b301-4238-b21a-e36fdbf052d6\") " pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:36:34.892911 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.892879    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvzg\" (UniqueName: \"kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg\") pod \"authorino-56c6c9ddd5-5ldzt\" (UID: \"53cd289f-b301-4238-b21a-e36fdbf052d6\") " pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:36:34.914193 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:34.914159    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvzg\" (UniqueName: \"kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg\") pod \"authorino-56c6c9ddd5-5ldzt\" (UID: \"53cd289f-b301-4238-b21a-e36fdbf052d6\") " pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:36:35.005978 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.005896    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:36:35.327014 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.326931    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5ldzt"]
Nov 03 21:36:35.330402 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:35.330370    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53cd289f_b301_4238_b21a_e36fdbf052d6.slice/crio-37e3960374fddac457263d028844db74d63b5346ad780cd50a722c4fce1a2a31 WatchSource:0}: Error finding container 37e3960374fddac457263d028844db74d63b5346ad780cd50a722c4fce1a2a31: Status 404 returned error can't find the container with id 37e3960374fddac457263d028844db74d63b5346ad780cd50a722c4fce1a2a31
Nov 03 21:36:35.721478 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.721438    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt" event={"ID":"53cd289f-b301-4238-b21a-e36fdbf052d6","Type":"ContainerStarted","Data":"37e3960374fddac457263d028844db74d63b5346ad780cd50a722c4fce1a2a31"}
Nov 03 21:36:35.723243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.723209    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g" event={"ID":"125ee10d-14b2-45cb-82cd-f52babe26bf9","Type":"ContainerStarted","Data":"4185960f450e51695f61c95f2be89e4bf6b3ac176d6079837c26a5ef6a275de7"}
Nov 03 21:36:35.767576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.767519    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b5554b6f8-x5m6g" podStartSLOduration=2.375835877 podStartE2EDuration="4.767504749s" totalImagesPullingTime="2.391668872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:35.767096699 +0000 UTC m=+365.733933454" watchObservedRunningTime="2026-11-03 21:36:35.767504749 +0000 UTC m=+365.734341480"
Nov 03 21:36:35.989771 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.989690    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"]
Nov 03 21:36:35.994527 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:35.994498    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.010755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.010723    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Nov 03 21:36:36.011721 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.011694    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"]
Nov 03 21:36:36.023625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.023525    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Nov 03 21:36:36.024062 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.023965    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Nov 03 21:36:36.024062 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.024018    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-v26fl\""
Nov 03 21:36:36.105147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.104856    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f05529-a6c4-42c1-b95e-497b3154a5fc-metrics-certs\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.105147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.104912    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7x2\" (UniqueName: \"kubernetes.io/projected/35f05529-a6c4-42c1-b95e-497b3154a5fc-kube-api-access-ht7x2\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.105147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.104950    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35f05529-a6c4-42c1-b95e-497b3154a5fc-manager-config\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.105147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.105000    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35f05529-a6c4-42c1-b95e-497b3154a5fc-cert\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.206590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.206552    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f05529-a6c4-42c1-b95e-497b3154a5fc-metrics-certs\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.206755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.206609    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7x2\" (UniqueName: \"kubernetes.io/projected/35f05529-a6c4-42c1-b95e-497b3154a5fc-kube-api-access-ht7x2\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.206755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.206650    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35f05529-a6c4-42c1-b95e-497b3154a5fc-manager-config\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.206755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.206711    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35f05529-a6c4-42c1-b95e-497b3154a5fc-cert\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.207533 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.207476    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/35f05529-a6c4-42c1-b95e-497b3154a5fc-manager-config\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.209692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.209647    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f05529-a6c4-42c1-b95e-497b3154a5fc-metrics-certs\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.210772 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.210728    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35f05529-a6c4-42c1-b95e-497b3154a5fc-cert\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.228630 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.228577    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7x2\" (UniqueName: \"kubernetes.io/projected/35f05529-a6c4-42c1-b95e-497b3154a5fc-kube-api-access-ht7x2\") pod \"jobset-controller-manager-57bbbbfc67-xjnfn\" (UID: \"35f05529-a6c4-42c1-b95e-497b3154a5fc\") " pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.310532 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.310450    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:36.627570 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.627538    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"]
Nov 03 21:36:36.631821 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:36:36.631784    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f05529_a6c4_42c1_b95e_497b3154a5fc.slice/crio-a94da2a523e54c7fb870faac73eafe18f761103b8c3ad2ae20a409f4ef790c5b WatchSource:0}: Error finding container a94da2a523e54c7fb870faac73eafe18f761103b8c3ad2ae20a409f4ef790c5b: Status 404 returned error can't find the container with id a94da2a523e54c7fb870faac73eafe18f761103b8c3ad2ae20a409f4ef790c5b
Nov 03 21:36:36.730953 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:36.730921    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn" event={"ID":"35f05529-a6c4-42c1-b95e-497b3154a5fc","Type":"ContainerStarted","Data":"a94da2a523e54c7fb870faac73eafe18f761103b8c3ad2ae20a409f4ef790c5b"}
Nov 03 21:36:37.735844 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:37.735803    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft" event={"ID":"3e1ca5c3-54c2-4547-a05f-fc19f08984b2","Type":"ContainerStarted","Data":"1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a"}
Nov 03 21:36:37.736310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:37.735970    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:37.737361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:37.737336    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt" event={"ID":"53cd289f-b301-4238-b21a-e36fdbf052d6","Type":"ContainerStarted","Data":"267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603"}
Nov 03 21:36:37.776816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:37.776757    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft" podStartSLOduration=1.763442141 podStartE2EDuration="4.776737678s" totalImagesPullingTime="3.013295537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:37.775692635 +0000 UTC m=+367.742529370" watchObservedRunningTime="2026-11-03 21:36:37.776737678 +0000 UTC m=+367.743574412"
Nov 03 21:36:39.748369 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:39.748335    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn" event={"ID":"35f05529-a6c4-42c1-b95e-497b3154a5fc","Type":"ContainerStarted","Data":"4aaf3b533211dff50368c8745f8986b1e76ba5892596eb84b06415617c4382c1"}
Nov 03 21:36:39.748812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:39.748555    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:36:39.788349 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:39.788291    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt" podStartSLOduration=3.939881267 podStartE2EDuration="5.788275298s" totalImagesPullingTime="1.848394031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:37.814678312 +0000 UTC m=+367.781515057" watchObservedRunningTime="2026-11-03 21:36:39.788275298 +0000 UTC m=+369.755112030"
Nov 03 21:36:39.789576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:39.789525    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn" podStartSLOduration=1.784001524 podStartE2EDuration="4.789514765s" totalImagesPullingTime="3.005513241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:36:39.787391856 +0000 UTC m=+369.754228611" watchObservedRunningTime="2026-11-03 21:36:39.789514765 +0000 UTC m=+369.756351500"
Nov 03 21:36:48.743836 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:48.743799    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:48.746916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:48.746886    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:48.788187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:48.788152    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft" podUID="3e1ca5c3-54c2-4547-a05f-fc19f08984b2" containerName="limitador" containerID="cri-o://1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a" gracePeriod=30
Nov 03 21:36:49.367005 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.366940    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:49.537225 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.537183    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt\" (UniqueName: \"kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt\") pod \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") "
Nov 03 21:36:49.537406 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.537300    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file\" (UniqueName: \"kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file\") pod \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\" (UID: \"3e1ca5c3-54c2-4547-a05f-fc19f08984b2\") "
Nov 03 21:36:49.537677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.537653    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file" pod "3e1ca5c3-54c2-4547-a05f-fc19f08984b2" (UID: "3e1ca5c3-54c2-4547-a05f-fc19f08984b2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:36:49.539463 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.539439    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt" pod "3e1ca5c3-54c2-4547-a05f-fc19f08984b2" (UID: "3e1ca5c3-54c2-4547-a05f-fc19f08984b2"). InnerVolumeSpecName "kube-api-access-m7vlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:36:49.638875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.638795    6774 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-config-file\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:36:49.638875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.638828    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7vlt\" (UniqueName: \"kubernetes.io/projected/3e1ca5c3-54c2-4547-a05f-fc19f08984b2-kube-api-access-m7vlt\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:36:49.793637 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.793603    6774 generic.go:356] "Generic (PLEG): container finished" podID="3e1ca5c3-54c2-4547-a05f-fc19f08984b2" containerID="1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a" exitCode=0
Nov 03 21:36:49.794079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.793649    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"
Nov 03 21:36:49.794079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.793658    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft" event={"ID":"3e1ca5c3-54c2-4547-a05f-fc19f08984b2","Type":"ContainerDied","Data":"1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a"}
Nov 03 21:36:49.794079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.793700    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fz5ft" event={"ID":"3e1ca5c3-54c2-4547-a05f-fc19f08984b2","Type":"ContainerDied","Data":"6b90854290e02687719d9284ca229d65864b0820bafca91c6497a65a875a42b3"}
Nov 03 21:36:49.794079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.793720    6774 scope.go:122] "RemoveContainer" containerID="1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a"
Nov 03 21:36:49.802594 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.802577    6774 scope.go:122] "RemoveContainer" containerID="1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a"
Nov 03 21:36:49.802885 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:36:49.802862    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a\": container with ID starting with 1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a not found: ID does not exist" containerID="1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a"
Nov 03 21:36:49.802946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.802894    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a"} err="failed to get container status \"1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a\": rpc error: code = NotFound desc = could not find container \"1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a\": container with ID starting with 1bc4f0b552b3546b06a7ba65479444d359c7aefa4894bc33f6edc3b41abf1e0a not found: ID does not exist"
Nov 03 21:36:49.846685 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.846656    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:49.859670 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:49.859641    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fz5ft"]
Nov 03 21:36:50.158731 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:50.158694    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e1ca5c3-54c2-4547-a05f-fc19f08984b2" path="/var/lib/kubelet/pods/3e1ca5c3-54c2-4547-a05f-fc19f08984b2/volumes"
Nov 03 21:36:50.757767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:36:50.757739    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-57bbbbfc67-xjnfn"
Nov 03 21:37:01.397171 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:37:01.397132    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:37:31.396704 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:37:31.396663    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:37:38.202721 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.202689    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"]
Nov 03 21:37:38.203174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.203045    6774 cpu_manager.go:414] "containerMap: removing container" podUID="3e1ca5c3-54c2-4547-a05f-fc19f08984b2" containerName="limitador"
Nov 03 21:37:38.203174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.203057    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e1ca5c3-54c2-4547-a05f-fc19f08984b2" containerName="limitador"
Nov 03 21:37:38.203174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.203119    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e1ca5c3-54c2-4547-a05f-fc19f08984b2" containerName="limitador"
Nov 03 21:37:38.207903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.207882    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.226752 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.226727    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"]
Nov 03 21:37:38.238391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.238368    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 03 21:37:38.238391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.238383    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 03 21:37:38.317052 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.317020    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 03 21:37:38.317052 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.317020    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k427c\""
Nov 03 21:37:38.370879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.370845    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-mr24m\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.371045 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.370901    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrg7\" (UniqueName: \"kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7\") pod \"llmisvc-controller-manager-869d5dcc5d-mr24m\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.472099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.472014    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-mr24m\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.472099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.472065    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrg7\" (UniqueName: \"kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7\") pod \"llmisvc-controller-manager-869d5dcc5d-mr24m\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.474409 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.474382    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-mr24m\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.492004 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.491980    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrg7\" (UniqueName: \"kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7\") pod \"llmisvc-controller-manager-869d5dcc5d-mr24m\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.519018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.518992    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:38.808280 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:38.808204    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"]
Nov 03 21:37:38.811165 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:37:38.811132    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde578876_8a40_4ddd_9340_ec4ce4884603.slice/crio-696529e185bdefb588fb055a6b7a7115244c43af787ced54a07f7d4396fa25dc WatchSource:0}: Error finding container 696529e185bdefb588fb055a6b7a7115244c43af787ced54a07f7d4396fa25dc: Status 404 returned error can't find the container with id 696529e185bdefb588fb055a6b7a7115244c43af787ced54a07f7d4396fa25dc
Nov 03 21:37:39.023741 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:39.023706    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m" event={"ID":"de578876-8a40-4ddd-9340-ec4ce4884603","Type":"ContainerStarted","Data":"696529e185bdefb588fb055a6b7a7115244c43af787ced54a07f7d4396fa25dc"}
Nov 03 21:37:41.034279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:41.034240    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m" event={"ID":"de578876-8a40-4ddd-9340-ec4ce4884603","Type":"ContainerStarted","Data":"5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b"}
Nov 03 21:37:41.034729 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:41.034345    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:37:41.074280 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:37:41.074229    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m" podStartSLOduration=1.050595829 podStartE2EDuration="3.074215715s" totalImagesPullingTime="2.023619886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:37:41.073237551 +0000 UTC m=+431.040074303" watchObservedRunningTime="2026-11-03 21:37:41.074215715 +0000 UTC m=+431.041052471"
Nov 03 21:38:00.722641 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.722601    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"]
Nov 03 21:38:00.732564 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.732539    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.749811 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.749778    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"]
Nov 03 21:38:00.761201 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.761175    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 03 21:38:00.828113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.828080    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pgck4\""
Nov 03 21:38:00.873268 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873233    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873268 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873273    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873350    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873450    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873472    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873488    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873518    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873727 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873590    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w24bx\" (UniqueName: \"kubernetes.io/projected/d4f3f780-1c36-4f45-bdc0-04a985131f32-kube-api-access-w24bx\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.873727 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.873682    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f3f780-1c36-4f45-bdc0-04a985131f32-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974305    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974338    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974353    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974489    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974533    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w24bx\" (UniqueName: \"kubernetes.io/projected/d4f3f780-1c36-4f45-bdc0-04a985131f32-kube-api-access-w24bx\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974624    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f3f780-1c36-4f45-bdc0-04a985131f32-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974664    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974919 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974700    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974919 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974705    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.974919 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974775    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.975031 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.974963    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.975084 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.975051    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.975226 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.975202    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.975602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.975575    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4f3f780-1c36-4f45-bdc0-04a985131f32-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.976792 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.976772    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.976976 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.976956    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.994912 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.994882    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4f3f780-1c36-4f45-bdc0-04a985131f32-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:00.995037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:00.995006    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w24bx\" (UniqueName: \"kubernetes.io/projected/d4f3f780-1c36-4f45-bdc0-04a985131f32-kube-api-access-w24bx\") pod \"maas-default-gateway-openshift-default-75d7c785f-lcs5b\" (UID: \"d4f3f780-1c36-4f45-bdc0-04a985131f32\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:01.045925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:01.045891    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:01.353792 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:01.353762    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"]
Nov 03 21:38:01.356357 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:38:01.356332    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f3f780_1c36_4f45_bdc0_04a985131f32.slice/crio-b0e923a4a9d30124d46e624fa7fbdd98c7dfef4fac49bfc6755f979cdd6b256f WatchSource:0}: Error finding container b0e923a4a9d30124d46e624fa7fbdd98c7dfef4fac49bfc6755f979cdd6b256f: Status 404 returned error can't find the container with id b0e923a4a9d30124d46e624fa7fbdd98c7dfef4fac49bfc6755f979cdd6b256f
Nov 03 21:38:01.397244 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:38:01.397204    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:38:02.127284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:02.127249    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" event={"ID":"d4f3f780-1c36-4f45-bdc0-04a985131f32","Type":"ContainerStarted","Data":"b0e923a4a9d30124d46e624fa7fbdd98c7dfef4fac49bfc6755f979cdd6b256f"}
Nov 03 21:38:08.508137 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:08.508105    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:38:08.508391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:08.508176    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:38:08.508391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:08.508206    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:38:09.167138 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:09.167102    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" event={"ID":"d4f3f780-1c36-4f45-bdc0-04a985131f32","Type":"ContainerStarted","Data":"381723f8b5a695558d4b8b8331bb7eea9b6d5f9794f11035c12e0e85babe8879"}
Nov 03 21:38:09.261470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:09.237908    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podStartSLOduration=2.088882004 podStartE2EDuration="9.237889872s" totalImagesPullingTime="7.149007868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:38:09.222582985 +0000 UTC m=+459.189419744" watchObservedRunningTime="2026-11-03 21:38:09.237889872 +0000 UTC m=+459.204726607"
Nov 03 21:38:10.052309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:10.052268    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-lcs5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Nov 03 21:38:10.052940 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:10.052897    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podUID="d4f3f780-1c36-4f45-bdc0-04a985131f32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Nov 03 21:38:10.053351 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:10.053328    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:11.052447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:11.051854    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-lcs5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Nov 03 21:38:11.052447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:11.051922    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podUID="d4f3f780-1c36-4f45-bdc0-04a985131f32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Nov 03 21:38:11.947924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:11.947883    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9m5zr"]
Nov 03 21:38:11.965165 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:11.965129    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:11.971331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:11.971304    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9m5zr"]
Nov 03 21:38:11.983047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:11.983025    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 03 21:38:12.061628 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.061578    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-lcs5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Nov 03 21:38:12.062104 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.061647    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podUID="d4f3f780-1c36-4f45-bdc0-04a985131f32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Nov 03 21:38:12.062104 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.061998    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:38:12.087124 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.087091    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert\") pod \"authorino-6889cbd8c4-9m5zr\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") " pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.087283 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.087152    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljcvc\" (UniqueName: \"kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc\") pod \"authorino-6889cbd8c4-9m5zr\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") " pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.088459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.088437    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9m5zr"]
Nov 03 21:38:12.088653 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:38:12.088636    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ljcvc tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-9m5zr" podUID="049595a1-5d30-4c6f-b266-ad3bbd28f609"
Nov 03 21:38:12.181375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.181346    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.188504 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.188477    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert\") pod \"authorino-6889cbd8c4-9m5zr\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") " pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.188644 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.188532    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljcvc\" (UniqueName: \"kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc\") pod \"authorino-6889cbd8c4-9m5zr\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") " pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.188959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.188897    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.190881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.190859    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert\") pod \"authorino-6889cbd8c4-9m5zr\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") " pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.208247 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.208182    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljcvc\" (UniqueName: \"kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc\") pod \"authorino-6889cbd8c4-9m5zr\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") " pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:12.289281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.289241    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc\" (UniqueName: \"kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc\") pod \"049595a1-5d30-4c6f-b266-ad3bbd28f609\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") "
Nov 03 21:38:12.289481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.289294    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert\" (UniqueName: \"kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert\") pod \"049595a1-5d30-4c6f-b266-ad3bbd28f609\" (UID: \"049595a1-5d30-4c6f-b266-ad3bbd28f609\") "
Nov 03 21:38:12.291434 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.291389    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert" pod "049595a1-5d30-4c6f-b266-ad3bbd28f609" (UID: "049595a1-5d30-4c6f-b266-ad3bbd28f609"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:38:12.291542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.291441    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc" pod "049595a1-5d30-4c6f-b266-ad3bbd28f609" (UID: "049595a1-5d30-4c6f-b266-ad3bbd28f609"). InnerVolumeSpecName "kube-api-access-ljcvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:38:12.390502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.390468    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljcvc\" (UniqueName: \"kubernetes.io/projected/049595a1-5d30-4c6f-b266-ad3bbd28f609-kube-api-access-ljcvc\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:38:12.390502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:12.390497    6774 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/049595a1-5d30-4c6f-b266-ad3bbd28f609-tls-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:38:13.055446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:13.054822    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-lcs5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Nov 03 21:38:13.055446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:13.054887    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podUID="d4f3f780-1c36-4f45-bdc0-04a985131f32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Nov 03 21:38:13.186531 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:13.186501    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-9m5zr"
Nov 03 21:38:13.282555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:13.282518    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9m5zr"]
Nov 03 21:38:13.288562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:13.288530    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-9m5zr"]
Nov 03 21:38:14.057906 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.057865    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-lcs5b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Nov 03 21:38:14.058687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.058171    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podUID="d4f3f780-1c36-4f45-bdc0-04a985131f32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Nov 03 21:38:14.165034 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.164998    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="049595a1-5d30-4c6f-b266-ad3bbd28f609" path="/var/lib/kubelet/pods/049595a1-5d30-4c6f-b266-ad3bbd28f609/volumes"
Nov 03 21:38:14.189735 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.189701    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5ldzt"]
Nov 03 21:38:14.190223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.189869    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt" podUID="53cd289f-b301-4238-b21a-e36fdbf052d6" containerName="authorino" containerID="cri-o://267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603" gracePeriod=30
Nov 03 21:38:14.458868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.458841    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:38:14.611476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.611431    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg\" (UniqueName: \"kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg\") pod \"53cd289f-b301-4238-b21a-e36fdbf052d6\" (UID: \"53cd289f-b301-4238-b21a-e36fdbf052d6\") "
Nov 03 21:38:14.613651 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.613621    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg" pod "53cd289f-b301-4238-b21a-e36fdbf052d6" (UID: "53cd289f-b301-4238-b21a-e36fdbf052d6"). InnerVolumeSpecName "kube-api-access-dvvzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:38:14.712550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:14.712458    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvvzg\" (UniqueName: \"kubernetes.io/projected/53cd289f-b301-4238-b21a-e36fdbf052d6-kube-api-access-dvvzg\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:38:15.050393 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.050309    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:15.050713 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.050693    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:15.051389 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.051368    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b"
Nov 03 21:38:15.197688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.197651    6774 generic.go:356] "Generic (PLEG): container finished" podID="53cd289f-b301-4238-b21a-e36fdbf052d6" containerID="267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603" exitCode=0
Nov 03 21:38:15.198155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.197692    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt"
Nov 03 21:38:15.198155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.197698    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt" event={"ID":"53cd289f-b301-4238-b21a-e36fdbf052d6","Type":"ContainerDied","Data":"267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603"}
Nov 03 21:38:15.198155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.197746    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-5ldzt" event={"ID":"53cd289f-b301-4238-b21a-e36fdbf052d6","Type":"ContainerDied","Data":"37e3960374fddac457263d028844db74d63b5346ad780cd50a722c4fce1a2a31"}
Nov 03 21:38:15.198155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.197766    6774 scope.go:122] "RemoveContainer" containerID="267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603"
Nov 03 21:38:15.207901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.207885    6774 scope.go:122] "RemoveContainer" containerID="267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603"
Nov 03 21:38:15.208185 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:38:15.208168    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603\": container with ID starting with 267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603 not found: ID does not exist" containerID="267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603"
Nov 03 21:38:15.208228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.208194    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603"} err="failed to get container status \"267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603\": rpc error: code = NotFound desc = could not find container \"267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603\": container with ID starting with 267124ad16b9caa27c1e111da8cb76388b6925c68ba9a3037958ebe475e28603 not found: ID does not exist"
Nov 03 21:38:15.250143 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.250112    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5ldzt"]
Nov 03 21:38:15.252918 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:15.252892    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-5ldzt"]
Nov 03 21:38:16.157474 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:16.157415    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53cd289f-b301-4238-b21a-e36fdbf052d6" path="/var/lib/kubelet/pods/53cd289f-b301-4238-b21a-e36fdbf052d6/volumes"
Nov 03 21:38:31.397072 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:38:31.397034    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:38:35.255667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.255624    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"]
Nov 03 21:38:35.256049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.256005    6774 cpu_manager.go:414] "containerMap: removing container" podUID="53cd289f-b301-4238-b21a-e36fdbf052d6" containerName="authorino"
Nov 03 21:38:35.256049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.256018    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53cd289f-b301-4238-b21a-e36fdbf052d6" containerName="authorino"
Nov 03 21:38:35.256131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.256086    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="53cd289f-b301-4238-b21a-e36fdbf052d6" containerName="authorino"
Nov 03 21:38:35.260328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.260309    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.277600 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.277572    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"]
Nov 03 21:38:35.298825 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.298789    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wn8\" (UniqueName: \"kubernetes.io/projected/5d69a1a7-c95d-474a-9a47-b1178c34d7ef-kube-api-access-k9wn8\") pod \"llmisvc-controller-manager-6466c554d8-xd5q8\" (UID: \"5d69a1a7-c95d-474a-9a47-b1178c34d7ef\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.298961 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.298907    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d69a1a7-c95d-474a-9a47-b1178c34d7ef-cert\") pod \"llmisvc-controller-manager-6466c554d8-xd5q8\" (UID: \"5d69a1a7-c95d-474a-9a47-b1178c34d7ef\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.400054 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.400029    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wn8\" (UniqueName: \"kubernetes.io/projected/5d69a1a7-c95d-474a-9a47-b1178c34d7ef-kube-api-access-k9wn8\") pod \"llmisvc-controller-manager-6466c554d8-xd5q8\" (UID: \"5d69a1a7-c95d-474a-9a47-b1178c34d7ef\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.400212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.400088    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d69a1a7-c95d-474a-9a47-b1178c34d7ef-cert\") pod \"llmisvc-controller-manager-6466c554d8-xd5q8\" (UID: \"5d69a1a7-c95d-474a-9a47-b1178c34d7ef\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.402454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.402410    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d69a1a7-c95d-474a-9a47-b1178c34d7ef-cert\") pod \"llmisvc-controller-manager-6466c554d8-xd5q8\" (UID: \"5d69a1a7-c95d-474a-9a47-b1178c34d7ef\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.419991 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.419963    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wn8\" (UniqueName: \"kubernetes.io/projected/5d69a1a7-c95d-474a-9a47-b1178c34d7ef-kube-api-access-k9wn8\") pod \"llmisvc-controller-manager-6466c554d8-xd5q8\" (UID: \"5d69a1a7-c95d-474a-9a47-b1178c34d7ef\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.573238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.573153    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:35.864720 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:35.864692    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"]
Nov 03 21:38:35.867220 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:38:35.867197    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d69a1a7_c95d_474a_9a47_b1178c34d7ef.slice/crio-e8aa03640c9fcec96fc10d1572e6efafdb27a337b477ed17793d8e48b14b0948 WatchSource:0}: Error finding container e8aa03640c9fcec96fc10d1572e6efafdb27a337b477ed17793d8e48b14b0948: Status 404 returned error can't find the container with id e8aa03640c9fcec96fc10d1572e6efafdb27a337b477ed17793d8e48b14b0948
Nov 03 21:38:36.295492 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:36.295451    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8" event={"ID":"5d69a1a7-c95d-474a-9a47-b1178c34d7ef","Type":"ContainerStarted","Data":"b35d8bcf8a94c3ca6376d807c9fd672e96a98297261fa0e2ed4d687c25e449af"}
Nov 03 21:38:36.295897 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:36.295508    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8" event={"ID":"5d69a1a7-c95d-474a-9a47-b1178c34d7ef","Type":"ContainerStarted","Data":"e8aa03640c9fcec96fc10d1572e6efafdb27a337b477ed17793d8e48b14b0948"}
Nov 03 21:38:36.295897 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:36.295560    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:38:36.336090 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:36.336031    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8" podStartSLOduration=1.057003658 podStartE2EDuration="1.336017402s" totalImagesPullingTime="279.013744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:38:36.334265162 +0000 UTC m=+486.301101897" watchObservedRunningTime="2026-11-03 21:38:36.336017402 +0000 UTC m=+486.302854154"
Nov 03 21:38:45.847853 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:45.847797    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"]
Nov 03 21:38:45.855135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:45.855114    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:45.875778 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:45.875747    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"]
Nov 03 21:38:46.006146 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006110    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006315 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006152    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffdd\" (UniqueName: \"kubernetes.io/projected/d7ce2554-a321-4503-ac13-dbbb1085f3a6-kube-api-access-6ffdd\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006315 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006242    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006388 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006324    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006388 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006362    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006486 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006460    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006533 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006520    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006568 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006543    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.006603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.006567    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107335 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107255    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107335 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107298    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107335 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107320    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107366    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107384    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107399    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107445    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107484    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffdd\" (UniqueName: \"kubernetes.io/projected/d7ce2554-a321-4503-ac13-dbbb1085f3a6-kube-api-access-6ffdd\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107514    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107906 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107871    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.107991 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.107964    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.108049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.108028    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.108088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.108070    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.108246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.108229    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.109828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.109811    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.109945 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.109927    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.127592 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.127563    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffdd\" (UniqueName: \"kubernetes.io/projected/d7ce2554-a321-4503-ac13-dbbb1085f3a6-kube-api-access-6ffdd\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.127592 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.127579    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7ce2554-a321-4503-ac13-dbbb1085f3a6-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-zt4t7\" (UID: \"d7ce2554-a321-4503-ac13-dbbb1085f3a6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.168051 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.168023    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:46.477180 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.477093    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"]
Nov 03 21:38:46.481448 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:38:46.481408    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ce2554_a321_4503_ac13_dbbb1085f3a6.slice/crio-5fefb2aa2f2a004a4bdca48ab37f519475b7526ea658b25625de27bc7297b997 WatchSource:0}: Error finding container 5fefb2aa2f2a004a4bdca48ab37f519475b7526ea658b25625de27bc7297b997: Status 404 returned error can't find the container with id 5fefb2aa2f2a004a4bdca48ab37f519475b7526ea658b25625de27bc7297b997
Nov 03 21:38:46.483523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.483491    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:38:46.483606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.483559    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:38:46.483656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:46.483602    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:38:47.366447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:47.365324    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" event={"ID":"d7ce2554-a321-4503-ac13-dbbb1085f3a6","Type":"ContainerStarted","Data":"6765a57700b14e17645571f02cfe0e98743a0ed55b86d823b1539ef5821ce4a2"}
Nov 03 21:38:47.366447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:47.365394    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" event={"ID":"d7ce2554-a321-4503-ac13-dbbb1085f3a6","Type":"ContainerStarted","Data":"5fefb2aa2f2a004a4bdca48ab37f519475b7526ea658b25625de27bc7297b997"}
Nov 03 21:38:47.421141 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:47.421092    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podStartSLOduration=2.421074565 podStartE2EDuration="2.421074565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:38:47.419194725 +0000 UTC m=+497.386031456" watchObservedRunningTime="2026-11-03 21:38:47.421074565 +0000 UTC m=+497.387911295"
Nov 03 21:38:48.168768 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:48.168732    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:48.170237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:48.170212    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Nov 03 21:38:48.170327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:48.170261    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Nov 03 21:38:49.168493 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:49.168456    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Nov 03 21:38:49.168980 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:49.168515    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Nov 03 21:38:50.168355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:50.168317    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Nov 03 21:38:50.168546 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:50.168374    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Nov 03 21:38:51.169003 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:51.168967    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Nov 03 21:38:51.169407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:51.169032    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Nov 03 21:38:52.168758 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:52.168725    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Nov 03 21:38:52.168938 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:52.168779    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Nov 03 21:38:53.173055 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:53.173022    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:53.173530 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:53.173308    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:38:53.173969 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:38:53.173951    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7"
Nov 03 21:39:00.892805 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.892767    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"]
Nov 03 21:39:00.896408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.896391    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.917624 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.917599    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"]
Nov 03 21:39:00.957820 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.957786    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.957820 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.957824    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772e952-a407-4c76-babc-20f3bca31802-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.957858    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.957935    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.957956    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.957974    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772e952-a407-4c76-babc-20f3bca31802-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958150 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.958049    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772e952-a407-4c76-babc-20f3bca31802-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958150 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.958086    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:00.958211 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:00.958166    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvkk2\" (UniqueName: \"kubernetes.io/projected/2772e952-a407-4c76-babc-20f3bca31802-kube-api-access-bvkk2\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059055 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059011    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvkk2\" (UniqueName: \"kubernetes.io/projected/2772e952-a407-4c76-babc-20f3bca31802-kube-api-access-bvkk2\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059065    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059096    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772e952-a407-4c76-babc-20f3bca31802-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059142    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059180    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059212    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059239    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772e952-a407-4c76-babc-20f3bca31802-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059612 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059292    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772e952-a407-4c76-babc-20f3bca31802-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059612 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059330    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059719 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059623    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-workload-certs\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059752    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-istio-data\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.059842 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.059780    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-credential-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.060019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.060000    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-workload-socket\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.060019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.060007    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2772e952-a407-4c76-babc-20f3bca31802-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.061547 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.061525    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2772e952-a407-4c76-babc-20f3bca31802-istio-envoy\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.061878 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.061855    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2772e952-a407-4c76-babc-20f3bca31802-istio-podinfo\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.078864 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.078838    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2772e952-a407-4c76-babc-20f3bca31802-istio-token\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.079023 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.078999    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvkk2\" (UniqueName: \"kubernetes.io/projected/2772e952-a407-4c76-babc-20f3bca31802-kube-api-access-bvkk2\") pod \"maas-default-gateway-openshift-default-75d7c785f-f49qd\" (UID: \"2772e952-a407-4c76-babc-20f3bca31802\") " pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.209747 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.209662    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:01.397012 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:39:01.396973    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:39:01.517475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.517377    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"]
Nov 03 21:39:01.520601 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:39:01.520576    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2772e952_a407_4c76_babc_20f3bca31802.slice/crio-4346a52279540b42974fd462613dcb9a55db1d2d4b70d32b4339f86a97e4b717 WatchSource:0}: Error finding container 4346a52279540b42974fd462613dcb9a55db1d2d4b70d32b4339f86a97e4b717: Status 404 returned error can't find the container with id 4346a52279540b42974fd462613dcb9a55db1d2d4b70d32b4339f86a97e4b717
Nov 03 21:39:01.522738 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.522706    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:39:01.522820 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.522788    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:39:01.522876 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:01.522831    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:39:02.463772 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:02.463730    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" event={"ID":"2772e952-a407-4c76-babc-20f3bca31802","Type":"ContainerStarted","Data":"e9262bbc0daca6c2673d713b47ca81e9e2afc3db598568b85ac596f8edf693ff"}
Nov 03 21:39:02.464343 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:02.463786    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" event={"ID":"2772e952-a407-4c76-babc-20f3bca31802","Type":"ContainerStarted","Data":"4346a52279540b42974fd462613dcb9a55db1d2d4b70d32b4339f86a97e4b717"}
Nov 03 21:39:02.506084 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:02.506022    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podStartSLOduration=2.506003428 podStartE2EDuration="2.506003428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:39:02.505100186 +0000 UTC m=+512.471936942" watchObservedRunningTime="2026-11-03 21:39:02.506003428 +0000 UTC m=+512.472840166"
Nov 03 21:39:03.210207 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:03.210172    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:03.211715 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:03.211689    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Nov 03 21:39:03.211819 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:03.211738    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Nov 03 21:39:04.210449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:04.210387    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Nov 03 21:39:04.210847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:04.210467    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Nov 03 21:39:05.210349 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:05.210315    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Nov 03 21:39:05.210554 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:05.210373    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Nov 03 21:39:06.210649 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:06.210611    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Nov 03 21:39:06.211036 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:06.210677    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Nov 03 21:39:07.210834 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.210801    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Nov 03 21:39:07.211227 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.210867    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Nov 03 21:39:07.302622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.302588    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-xd5q8"
Nov 03 21:39:07.370566 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.370530    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"]
Nov 03 21:39:07.370822 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.370794    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m" podUID="de578876-8a40-4ddd-9340-ec4ce4884603" containerName="manager" containerID="cri-o://5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b" gracePeriod=30
Nov 03 21:39:07.626198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.626173    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:39:07.726191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.726153    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert\" (UniqueName: \"kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert\") pod \"de578876-8a40-4ddd-9340-ec4ce4884603\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") "
Nov 03 21:39:07.726379 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.726252    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7\" (UniqueName: \"kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7\") pod \"de578876-8a40-4ddd-9340-ec4ce4884603\" (UID: \"de578876-8a40-4ddd-9340-ec4ce4884603\") "
Nov 03 21:39:07.728344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.728309    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert" pod "de578876-8a40-4ddd-9340-ec4ce4884603" (UID: "de578876-8a40-4ddd-9340-ec4ce4884603"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:39:07.728473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.728340    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7" pod "de578876-8a40-4ddd-9340-ec4ce4884603" (UID: "de578876-8a40-4ddd-9340-ec4ce4884603"). InnerVolumeSpecName "kube-api-access-9zrg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:39:07.827067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.826986    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zrg7\" (UniqueName: \"kubernetes.io/projected/de578876-8a40-4ddd-9340-ec4ce4884603-kube-api-access-9zrg7\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:39:07.827067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:07.827017    6774 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/de578876-8a40-4ddd-9340-ec4ce4884603-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:39:08.213521 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.213493    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:08.213966 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.213767    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:08.214523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.214502    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd"
Nov 03 21:39:08.495027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.494941    6774 generic.go:356] "Generic (PLEG): container finished" podID="de578876-8a40-4ddd-9340-ec4ce4884603" containerID="5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b" exitCode=0
Nov 03 21:39:08.495027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.494990    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"
Nov 03 21:39:08.495027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.495016    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m" event={"ID":"de578876-8a40-4ddd-9340-ec4ce4884603","Type":"ContainerDied","Data":"5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b"}
Nov 03 21:39:08.495250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.495070    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m" event={"ID":"de578876-8a40-4ddd-9340-ec4ce4884603","Type":"ContainerDied","Data":"696529e185bdefb588fb055a6b7a7115244c43af787ced54a07f7d4396fa25dc"}
Nov 03 21:39:08.495250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.495093    6774 scope.go:122] "RemoveContainer" containerID="5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b"
Nov 03 21:39:08.503218 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.503192    6774 scope.go:122] "RemoveContainer" containerID="5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b"
Nov 03 21:39:08.503588 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:39:08.503570    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b\": container with ID starting with 5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b not found: ID does not exist" containerID="5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b"
Nov 03 21:39:08.503676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.503595    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b"} err="failed to get container status \"5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b\": rpc error: code = NotFound desc = could not find container \"5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b\": container with ID starting with 5137f7c2751ef4c517b11be06910639420c3d5477aa86423d1ef072cd133766b not found: ID does not exist"
Nov 03 21:39:08.548235 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.548199    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"]
Nov 03 21:39:08.552338 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:08.552312    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mr24m"]
Nov 03 21:39:10.157074 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:39:10.157044    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de578876-8a40-4ddd-9340-ec4ce4884603" path="/var/lib/kubelet/pods/de578876-8a40-4ddd-9340-ec4ce4884603/volumes"
Nov 03 21:39:31.397741 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:39:31.397629    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:40:01.398598 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:40:01.398559    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:40:31.398009 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:40:31.397974    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:41:01.397331 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:41:01.397287    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:41:31.397180 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:41:31.397102    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:41:48.250702 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.250668    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"]
Nov 03 21:41:48.251152 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.251052    6774 cpu_manager.go:414] "containerMap: removing container" podUID="de578876-8a40-4ddd-9340-ec4ce4884603" containerName="manager"
Nov 03 21:41:48.251152 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.251064    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de578876-8a40-4ddd-9340-ec4ce4884603" containerName="manager"
Nov 03 21:41:48.251152 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.251126    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="de578876-8a40-4ddd-9340-ec4ce4884603" containerName="manager"
Nov 03 21:41:48.254055 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.254037    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.282828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.282800    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w5-0a6da1-dockercfg-5744c\""
Nov 03 21:41:48.282966 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.282849    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w5-0a6da1\""
Nov 03 21:41:48.284324 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.284304    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"]
Nov 03 21:41:48.381677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.381648    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbc4\" (UniqueName: \"kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4\") pod \"payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.381881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.381729    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.482580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.482550    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.482749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.482671    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbc4\" (UniqueName: \"kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4\") pod \"payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.483268 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.483246    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.503076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.503012    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbc4\" (UniqueName: \"kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4\") pod \"payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.567311 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.567280    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:48.860637 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.860612    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"]
Nov 03 21:41:48.861827 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:41:48.861800    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ec3eb8_fcda_4d89_9c74_2957364cc013.slice/crio-1aa1a8043aa08293131f8bb0113e28b5b406677efa91856dbc0df7dc1d9d19fb WatchSource:0}: Error finding container 1aa1a8043aa08293131f8bb0113e28b5b406677efa91856dbc0df7dc1d9d19fb: Status 404 returned error can't find the container with id 1aa1a8043aa08293131f8bb0113e28b5b406677efa91856dbc0df7dc1d9d19fb
Nov 03 21:41:48.864100 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:48.864076    6774 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:41:49.356761 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:49.356666    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" event={"ID":"50ec3eb8-fcda-4d89-9c74-2957364cc013","Type":"ContainerStarted","Data":"1aa1a8043aa08293131f8bb0113e28b5b406677efa91856dbc0df7dc1d9d19fb"}
Nov 03 21:41:50.390966 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.390931    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"]
Nov 03 21:41:50.399686 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.399660    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.413571 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.413539    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"]
Nov 03 21:41:50.425668 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.425642    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-05bc27\""
Nov 03 21:41:50.425926 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.425903    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-05bc27-dockercfg-2bz6d\""
Nov 03 21:41:50.504839 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.504800    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.505017 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.504878    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwss\" (UniqueName: \"kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss\") pod \"payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.605625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.605585    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.605811 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.605673    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwss\" (UniqueName: \"kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss\") pod \"payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.606590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.606564    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.628888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.628859    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwss\" (UniqueName: \"kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss\") pod \"payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:50.715979 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:50.715892    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:51.017521 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.017491    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"]
Nov 03 21:41:51.018555 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:41:51.018533    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfdf623_99f3_42ec_94b2_6938435b9d8e.slice/crio-5ea7caf59991464893ace397bb9bac4411411bbc99ba4ecb7ab2347129457d89 WatchSource:0}: Error finding container 5ea7caf59991464893ace397bb9bac4411411bbc99ba4ecb7ab2347129457d89: Status 404 returned error can't find the container with id 5ea7caf59991464893ace397bb9bac4411411bbc99ba4ecb7ab2347129457d89
Nov 03 21:41:51.368837 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.368803    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w" event={"ID":"bcfdf623-99f3-42ec-94b2-6938435b9d8e","Type":"ContainerStarted","Data":"dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a"}
Nov 03 21:41:51.369020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.368870    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:41:51.369020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.368899    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w" event={"ID":"bcfdf623-99f3-42ec-94b2-6938435b9d8e","Type":"ContainerStarted","Data":"5ea7caf59991464893ace397bb9bac4411411bbc99ba4ecb7ab2347129457d89"}
Nov 03 21:41:51.370347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.370322    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" event={"ID":"50ec3eb8-fcda-4d89-9c74-2957364cc013","Type":"ContainerStarted","Data":"a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc"}
Nov 03 21:41:51.370478 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.370462    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:41:51.410321 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.410276    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w" podStartSLOduration=1.410264424 podStartE2EDuration="1.410264424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:41:51.408833594 +0000 UTC m=+681.375670330" watchObservedRunningTime="2026-11-03 21:41:51.410264424 +0000 UTC m=+681.377101191"
Nov 03 21:41:51.449645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:51.449601    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" podStartSLOduration=1.40498556 podStartE2EDuration="3.44958578s" totalImagesPullingTime="2.04460022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:41:51.448446453 +0000 UTC m=+681.415283191" watchObservedRunningTime="2026-11-03 21:41:51.44958578 +0000 UTC m=+681.416422491"
Nov 03 21:41:54.499086 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.499054    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"]
Nov 03 21:41:54.502889 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.502864    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.536031 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.535999    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-dd5620-serving-cert\""
Nov 03 21:41:54.536194 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.536081    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 21:41:54.536194 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.536148    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bl9fk\""
Nov 03 21:41:54.536194 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.536154    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 21:41:54.536333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.536220    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 21:41:54.537879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.537854    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"]
Nov 03 21:41:54.645780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.645738    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9xx\" (UniqueName: \"kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.645952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.645807    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.646049 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.646024    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.646145 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.646126    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.746704 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.746666    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.746903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.746745    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.746903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.746871    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9xx\" (UniqueName: \"kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.747028 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.746953    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.747896 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:41:54.747848    6774 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-serving-cert: secret "maas-api-e2e-worker-w3-dd5620-serving-cert" not found
Nov 03 21:41:54.748034 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:41:54.747960    6774 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls podName:4dd61259-091d-4548-8425-a848b9780120 nodeName:}" failed. No retries permitted until 2026-11-03 21:41:55.247939076 +0000 UTC m=+685.214775806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls") pod "maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" (UID: "4dd61259-091d-4548-8425-a848b9780120") : secret "maas-api-e2e-worker-w3-dd5620-serving-cert" not found
Nov 03 21:41:54.748248 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.748221    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.750550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.750495    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.769706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.769675    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9xx\" (UniqueName: \"kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:54.786074 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.786042    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"]
Nov 03 21:41:54.790417 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.790398    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:54.809064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.809033    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"]
Nov 03 21:41:54.816496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.816474    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-517149\""
Nov 03 21:41:54.835569 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.835547    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w6-517149-dockercfg-g2n5w\""
Nov 03 21:41:54.847851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.847821    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:54.847968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.847877    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6gx7\" (UniqueName: \"kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7\") pod \"payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:54.949140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.949106    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6gx7\" (UniqueName: \"kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7\") pod \"payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:54.949321 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.949214    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:54.949958 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.949939    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume\") pod \"payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:54.972142 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:54.972115    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6gx7\" (UniqueName: \"kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7\") pod \"payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") " pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:55.103808 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:55.103772    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:55.252404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:55.252366    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:55.254784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:55.254764    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:55.397306 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:55.397275    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"]
Nov 03 21:41:55.398580 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:41:55.398554    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4dcc05_fefc_4f94_8505_841d9d38ec19.slice/crio-0fc6ea329d3b75ce3e72ff916275a8ea03366ceabe0256837de2e7dbe7d056a2 WatchSource:0}: Error finding container 0fc6ea329d3b75ce3e72ff916275a8ea03366ceabe0256837de2e7dbe7d056a2: Status 404 returned error can't find the container with id 0fc6ea329d3b75ce3e72ff916275a8ea03366ceabe0256837de2e7dbe7d056a2
Nov 03 21:41:55.415862 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:55.415660    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:55.720826 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:55.720796    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"]
Nov 03 21:41:55.723283 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:41:55.723248    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd61259_091d_4548_8425_a848b9780120.slice/crio-faa82d22951a23c90703ca2f6b8b42d7bb9546f5164bdb8ff770b3694c83273e WatchSource:0}: Error finding container faa82d22951a23c90703ca2f6b8b42d7bb9546f5164bdb8ff770b3694c83273e: Status 404 returned error can't find the container with id faa82d22951a23c90703ca2f6b8b42d7bb9546f5164bdb8ff770b3694c83273e
Nov 03 21:41:56.398871 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:56.398835    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" event={"ID":"4dd61259-091d-4548-8425-a848b9780120","Type":"ContainerStarted","Data":"faa82d22951a23c90703ca2f6b8b42d7bb9546f5164bdb8ff770b3694c83273e"}
Nov 03 21:41:56.400737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:56.400701    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" event={"ID":"2a4dcc05-fefc-4f94-8505-841d9d38ec19","Type":"ContainerStarted","Data":"96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85"}
Nov 03 21:41:56.400933 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:56.400755    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" event={"ID":"2a4dcc05-fefc-4f94-8505-841d9d38ec19","Type":"ContainerStarted","Data":"0fc6ea329d3b75ce3e72ff916275a8ea03366ceabe0256837de2e7dbe7d056a2"}
Nov 03 21:41:56.401540 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:56.401521    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:41:56.456929 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:56.456865    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" podStartSLOduration=2.456845876 podStartE2EDuration="2.456845876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:41:56.442665533 +0000 UTC m=+686.409502269" watchObservedRunningTime="2026-11-03 21:41:56.456845876 +0000 UTC m=+686.423682611"
Nov 03 21:41:57.757079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.757041    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"]
Nov 03 21:41:57.762223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.762194    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:57.777496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.777465    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"]
Nov 03 21:41:57.818576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.818543    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-e246f9\""
Nov 03 21:41:57.818576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.818543    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-e246f9-dockercfg-znz9n\""
Nov 03 21:41:57.879181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.879138    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcgr5\" (UniqueName: \"kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5\") pod \"payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:57.879354 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.879195    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:57.980414 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.980392    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcgr5\" (UniqueName: \"kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5\") pod \"payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:57.980514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.980441    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:57.981073 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:57.981054    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:58.001550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.001525    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcgr5\" (UniqueName: \"kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5\") pod \"payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:58.079944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.079911    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:41:58.371328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.371296    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"]
Nov 03 21:41:58.373011 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:41:58.372985    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35527d13_8be1_46e8_a796_08fb7882a946.slice/crio-43fae864e2125e4f03cf3c0c65df96237f8f9552eacdea7f5ad9d3de5d0cc628 WatchSource:0}: Error finding container 43fae864e2125e4f03cf3c0c65df96237f8f9552eacdea7f5ad9d3de5d0cc628: Status 404 returned error can't find the container with id 43fae864e2125e4f03cf3c0c65df96237f8f9552eacdea7f5ad9d3de5d0cc628
Nov 03 21:41:58.414929 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.414895    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" event={"ID":"4dd61259-091d-4548-8425-a848b9780120","Type":"ContainerStarted","Data":"060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a"}
Nov 03 21:41:58.415088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.415001    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:41:58.416120 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.416095    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p" event={"ID":"35527d13-8be1-46e8-a796-08fb7882a946","Type":"ContainerStarted","Data":"43fae864e2125e4f03cf3c0c65df96237f8f9552eacdea7f5ad9d3de5d0cc628"}
Nov 03 21:41:58.457093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:58.457046    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" podStartSLOduration=2.208808023 podStartE2EDuration="4.457032071s" totalImagesPullingTime="2.248224048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:41:58.45619919 +0000 UTC m=+688.423035954" watchObservedRunningTime="2026-11-03 21:41:58.457032071 +0000 UTC m=+688.423868818"
Nov 03 21:41:59.422697 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:59.422659    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p" event={"ID":"35527d13-8be1-46e8-a796-08fb7882a946","Type":"ContainerStarted","Data":"e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7"}
Nov 03 21:41:59.467188 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:41:59.467129    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p" podStartSLOduration=2.467114252 podStartE2EDuration="2.467114252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:41:59.465277425 +0000 UTC m=+689.432114158" watchObservedRunningTime="2026-11-03 21:41:59.467114252 +0000 UTC m=+689.433950986"
Nov 03 21:42:00.428159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:00.428127    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:42:01.398686 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:42:01.398644    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:42:02.378507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:02.378481    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:42:02.378959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:02.378542    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:42:04.428272 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:04.428244    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:42:08.419827 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:08.419793    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:42:09.349353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.349321    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"]
Nov 03 21:42:09.352990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.352969    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.372155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.372119    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"]
Nov 03 21:42:09.383671 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.383643    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-e246f9-serving-cert\""
Nov 03 21:42:09.490861 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.490825    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.491240 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.490963    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.491240 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.491023    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.491240 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.491049    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvc4\" (UniqueName: \"kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.592539 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.592500    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.592826 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.592808    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.592935 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.592922    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvc4\" (UniqueName: \"kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.593070 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.593058    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.593826 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:42:09.593807    6774 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-serving-cert: secret "maas-api-e2e-worker-w0-e246f9-serving-cert" not found
Nov 03 21:42:09.594318 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:42:09.594288    6774 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls podName:942ede37-4531-4b77-b085-f792cfc7bb37 nodeName:}" failed. No retries permitted until 2026-11-03 21:42:10.094263653 +0000 UTC m=+700.061100369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls") pod "maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" (UID: "942ede37-4531-4b77-b085-f792cfc7bb37") : secret "maas-api-e2e-worker-w0-e246f9-serving-cert" not found
Nov 03 21:42:09.594861 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.594837    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.596560 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.596541    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:09.630397 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:09.630303    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvc4\" (UniqueName: \"kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:10.099695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.099664    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:10.102189 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.102161    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:10.267754 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.267721    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:10.316327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.316289    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"]
Nov 03 21:42:10.328272 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.328238    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.344651 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.344619    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"]
Nov 03 21:42:10.361204 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.360343    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4eced5\"/\"default-dockercfg-z2tkr\""
Nov 03 21:42:10.361204 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.360565    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4eced5\"/\"simulator-w1-4eced5-kserve-self-signed-certs\""
Nov 03 21:42:10.414560 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.414528    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4eced5\"/\"openshift-service-ca.crt\""
Nov 03 21:42:10.414560 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.414534    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4eced5\"/\"kube-root-ca.crt\""
Nov 03 21:42:10.506226 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.506183    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khq6g\" (UniqueName: \"kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.506707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.506242    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.506707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.506377    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.506707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.506416    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.506707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.506542    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.506707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.506589    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.602433 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.602392    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"]
Nov 03 21:42:10.607236 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607190    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.607368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607243    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.607368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607285    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.607368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607316    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.607577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607377    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khq6g\" (UniqueName: \"kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.607577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607412    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.608381 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.607898    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.608381 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.608079    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.608381 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.608188    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.610291 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.610264    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.610591 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.610568    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.632159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.632130    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khq6g\" (UniqueName: \"kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g\") pod \"simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") " pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.685683 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.685646    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:10.986949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:10.986926    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"]
Nov 03 21:42:10.995642 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:42:10.995618    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode479bcc7_fbcb_47d2_941a_f60f5bf3aa1e.slice/crio-1261de296a0cd4d07b72ce72d303db7154e505532e3d1212bb8987d87f6a40f1 WatchSource:0}: Error finding container 1261de296a0cd4d07b72ce72d303db7154e505532e3d1212bb8987d87f6a40f1: Status 404 returned error can't find the container with id 1261de296a0cd4d07b72ce72d303db7154e505532e3d1212bb8987d87f6a40f1
Nov 03 21:42:11.436813 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:11.436784    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:42:11.493569 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:11.492906    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" event={"ID":"942ede37-4531-4b77-b085-f792cfc7bb37","Type":"ContainerStarted","Data":"c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53"}
Nov 03 21:42:11.493569 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:11.492967    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" event={"ID":"942ede37-4531-4b77-b085-f792cfc7bb37","Type":"ContainerStarted","Data":"fa5ba9a85da3eea0e336eac3ae2f8b18bded07f8deab485c18f9e9db6fe3f155"}
Nov 03 21:42:11.493810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:11.493677    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:11.495105 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:11.495074    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" event={"ID":"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e","Type":"ContainerStarted","Data":"1261de296a0cd4d07b72ce72d303db7154e505532e3d1212bb8987d87f6a40f1"}
Nov 03 21:42:11.544064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:11.544001    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" podStartSLOduration=2.189488236 podStartE2EDuration="2.543981431s" totalImagesPullingTime="354.493195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:42:11.542139247 +0000 UTC m=+701.508975985" watchObservedRunningTime="2026-11-03 21:42:11.543981431 +0000 UTC m=+701.510818170"
Nov 03 21:42:12.501845 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:12.501763    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" event={"ID":"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e","Type":"ContainerStarted","Data":"adecdf77d76eb20a4113b2ce380d940a4fc7f4e841f9e60905715a8234073225"}
Nov 03 21:42:12.542484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:12.542439    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podStartSLOduration=1.287389894 podStartE2EDuration="2.542411076s" totalImagesPullingTime="1.255021182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:42:12.541279602 +0000 UTC m=+702.508116355" watchObservedRunningTime="2026-11-03 21:42:12.542411076 +0000 UTC m=+702.509247809"
Nov 03 21:42:12.686745 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:12.686708    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:18.511936 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.511908    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:42:18.915647 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.915613    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"]
Nov 03 21:42:18.920085 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.920059    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:18.938127 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.938094    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"]
Nov 03 21:42:18.949810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.949772    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-27fdf4\"/\"default-dockercfg-xk82w\""
Nov 03 21:42:18.949810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.949799    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-27fdf4\"/\"kube-root-ca.crt\""
Nov 03 21:42:18.949810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.949810    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-27fdf4\"/\"simulator-w2-27fdf4-kserve-self-signed-certs\""
Nov 03 21:42:18.950022 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.949773    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-27fdf4\"/\"openshift-service-ca.crt\""
Nov 03 21:42:18.981418 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.981379    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:18.981618 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.981438    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:18.981618 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.981563    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5c7\" (UniqueName: \"kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:18.981737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.981638    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:18.981786 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.981752    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:18.981786 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:18.981780    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.082706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.082669    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.082706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.082711    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.082947 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.082732    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.082947 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.082803    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5c7\" (UniqueName: \"kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.082947 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.082853    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.083098 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.082952    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.083210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.083188    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.083293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.083232    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.083293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.083259    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.084935 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.084912    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.085231 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.085216    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.102965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.102932    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5c7\" (UniqueName: \"kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7\") pod \"simulator-w2-27fdf4-kserve-bd496665b-7p82t\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") " pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.232191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.232114    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:19.539932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:19.539908    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"]
Nov 03 21:42:19.541161 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:42:19.541142    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb69f395a_e6fe_4f1f_b8c9_9f95a00923d5.slice/crio-e28b9dd0109dd4732f28026e6d5368320bbf7bf5c01916f863af736489cb24e8 WatchSource:0}: Error finding container e28b9dd0109dd4732f28026e6d5368320bbf7bf5c01916f863af736489cb24e8: Status 404 returned error can't find the container with id e28b9dd0109dd4732f28026e6d5368320bbf7bf5c01916f863af736489cb24e8
Nov 03 21:42:20.546662 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:20.546623    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" event={"ID":"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5","Type":"ContainerStarted","Data":"8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e"}
Nov 03 21:42:20.546662 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:20.546670    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" event={"ID":"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5","Type":"ContainerStarted","Data":"e28b9dd0109dd4732f28026e6d5368320bbf7bf5c01916f863af736489cb24e8"}
Nov 03 21:42:20.685778 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:20.685743    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:20.698874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:20.698841    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:20.740591 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:20.740527    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podStartSLOduration=2.7405085209999998 podStartE2EDuration="2.740508521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:42:20.590337472 +0000 UTC m=+710.557174224" watchObservedRunningTime="2026-11-03 21:42:20.740508521 +0000 UTC m=+710.707345256"
Nov 03 21:42:21.232408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.232371    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:21.319096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.319064    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"]
Nov 03 21:42:21.326065 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.326040    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.341109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.341080    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"]
Nov 03 21:42:21.352905 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.352879    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-0a6da1\"/\"openshift-service-ca.crt\""
Nov 03 21:42:21.352905 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.352881    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-0a6da1\"/\"kube-root-ca.crt\""
Nov 03 21:42:21.355181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.355165    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a6da1\"/\"default-dockercfg-rdxmf\""
Nov 03 21:42:21.355237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.355216    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a6da1\"/\"simulator-w5-0a6da1-kserve-self-signed-certs\""
Nov 03 21:42:21.407775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.407739    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.407985 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.407797    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.407985 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.407892    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd52q\" (UniqueName: \"kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.407985 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.407917    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.407985 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.407957    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.408206 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.408049    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509143    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509188    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd52q\" (UniqueName: \"kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509208    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509631 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509260    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509631 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509301    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509631 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509399    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509787 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509638    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509787 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509714    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.509787 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.509769    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.511783 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.511754    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.511941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.511909    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.528648 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.528619    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd52q\" (UniqueName: \"kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q\") pod \"simulator-w5-0a6da1-kserve-6d7796b49-drxc9\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") " pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.563542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.563516    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:42:21.640073 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.640003    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:21.946967 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:21.946941    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"]
Nov 03 21:42:21.948138 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:42:21.948115    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6607d9a_18fc_42ba_99ab_75cef05fdf22.slice/crio-b0d9fe063fd803cac77bfbee2b76babe327787e6106c3b49245584a06e461ae3 WatchSource:0}: Error finding container b0d9fe063fd803cac77bfbee2b76babe327787e6106c3b49245584a06e461ae3: Status 404 returned error can't find the container with id b0d9fe063fd803cac77bfbee2b76babe327787e6106c3b49245584a06e461ae3
Nov 03 21:42:22.558749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:22.558707    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" event={"ID":"d6607d9a-18fc-42ba-99ab-75cef05fdf22","Type":"ContainerStarted","Data":"18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e"}
Nov 03 21:42:22.558947 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:22.558761    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" event={"ID":"d6607d9a-18fc-42ba-99ab-75cef05fdf22","Type":"ContainerStarted","Data":"b0d9fe063fd803cac77bfbee2b76babe327787e6106c3b49245584a06e461ae3"}
Nov 03 21:42:22.640154 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:22.640115    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:29.233303 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:29.233264    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:29.245924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:29.245899    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:29.307189 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:29.307134    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podStartSLOduration=8.307120982 podStartE2EDuration="8.307120982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:42:22.598761459 +0000 UTC m=+712.565598192" watchObservedRunningTime="2026-11-03 21:42:29.307120982 +0000 UTC m=+719.273957715"
Nov 03 21:42:29.608899 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:29.608866    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:42:30.894042 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.894000    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"]
Nov 03 21:42:30.901302 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.901274    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:30.915823 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.915795    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"]
Nov 03 21:42:30.927291 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.927259    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-05bc27\"/\"openshift-service-ca.crt\""
Nov 03 21:42:30.927483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.927291    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-05bc27\"/\"kube-root-ca.crt\""
Nov 03 21:42:30.927483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.927363    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-05bc27\"/\"default-dockercfg-dc6k9\""
Nov 03 21:42:30.930456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:30.930433    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-05bc27\"/\"simulator-w4-05bc27-kserve-self-signed-certs\""
Nov 03 21:42:31.007707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.007671    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.007707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.007714    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.007927 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.007821    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ghd5\" (UniqueName: \"kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.007927 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.007842    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.007927 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.007902    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.008047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.008009    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109208    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109270    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109355    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109388    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109477    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ghd5\" (UniqueName: \"kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109718 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109505    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109717    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109732    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.109992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.109966    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.112367 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.112320    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.112711 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.112689    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.130549 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.130510    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ghd5\" (UniqueName: \"kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5\") pod \"simulator-w4-05bc27-kserve-56874bfb94-mgj65\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") " pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.214516 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.214417    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:31.397957 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:42:31.397921    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:42:31.509915 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.509884    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"]
Nov 03 21:42:31.511322 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:42:31.511291    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82f65cc7_1290_4293_ae7f_f0f9965c4743.slice/crio-7fce063a1fdf9ce4ab621ca1017d378d50c5bc633ccc42d93e2a7fb0291b519e WatchSource:0}: Error finding container 7fce063a1fdf9ce4ab621ca1017d378d50c5bc633ccc42d93e2a7fb0291b519e: Status 404 returned error can't find the container with id 7fce063a1fdf9ce4ab621ca1017d378d50c5bc633ccc42d93e2a7fb0291b519e
Nov 03 21:42:31.611007 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.610964    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" event={"ID":"82f65cc7-1290-4293-ae7f-f0f9965c4743","Type":"ContainerStarted","Data":"c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41"}
Nov 03 21:42:31.611007 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.611012    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" event={"ID":"82f65cc7-1290-4293-ae7f-f0f9965c4743","Type":"ContainerStarted","Data":"7fce063a1fdf9ce4ab621ca1017d378d50c5bc633ccc42d93e2a7fb0291b519e"}
Nov 03 21:42:31.640598 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.640565    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:31.653163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.653113    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podStartSLOduration=1.653099673 podStartE2EDuration="1.653099673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:42:31.652171066 +0000 UTC m=+721.619007824" watchObservedRunningTime="2026-11-03 21:42:31.653099673 +0000 UTC m=+721.619936406"
Nov 03 21:42:31.653660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:31.653643    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:32.215370 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:32.215341    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:32.626997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:32.626964    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:42:41.214886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.214840    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:41.228077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.228052    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:41.674836 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.674811    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:42:41.864742 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.864703    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"]
Nov 03 21:42:41.868006 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.867987    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:41.884852 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.884827    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e246f9\"/\"kube-root-ca.crt\""
Nov 03 21:42:41.885017 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.884829    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e246f9\"/\"openshift-service-ca.crt\""
Nov 03 21:42:41.885109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.885001    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e246f9\"/\"default-dockercfg-pvxz5\""
Nov 03 21:42:41.885109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.885057    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e246f9\"/\"simulator-w0-e246f9-kserve-self-signed-certs\""
Nov 03 21:42:41.885932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:41.885913    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"]
Nov 03 21:42:42.026924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.026832    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.026924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.026882    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.027106 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.026997    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.027189 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.027167    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.027222 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.027214    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk8mg\" (UniqueName: \"kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.027265 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.027235    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.128784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.128751    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.128784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.128783    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.128807    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.128911    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.128954    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk8mg\" (UniqueName: \"kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.128979    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.129167    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.129231    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.129337 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.129300    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.131201 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.131175    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.131369 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.131350    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.149154 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.149132    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk8mg\" (UniqueName: \"kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg\") pod \"simulator-w0-e246f9-kserve-58645d5fb7-lwwcb\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") " pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.183753 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.183725    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:42.479110 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.479084    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"]
Nov 03 21:42:42.479904 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:42:42.479879    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2dbe4d6_b901_4b37_b7a0_40205b3df407.slice/crio-4178f02962b415510e02a5d0f18f868cefe1baf5bb7ec53866555fc38646a7be WatchSource:0}: Error finding container 4178f02962b415510e02a5d0f18f868cefe1baf5bb7ec53866555fc38646a7be: Status 404 returned error can't find the container with id 4178f02962b415510e02a5d0f18f868cefe1baf5bb7ec53866555fc38646a7be
Nov 03 21:42:42.670902 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.670862    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" event={"ID":"d2dbe4d6-b901-4b37-b7a0-40205b3df407","Type":"ContainerStarted","Data":"2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083"}
Nov 03 21:42:42.671077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.670933    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" event={"ID":"d2dbe4d6-b901-4b37-b7a0-40205b3df407","Type":"ContainerStarted","Data":"4178f02962b415510e02a5d0f18f868cefe1baf5bb7ec53866555fc38646a7be"}
Nov 03 21:42:42.713319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:42.713262    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podStartSLOduration=1.713249085 podStartE2EDuration="1.713249085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:42:42.71106637 +0000 UTC m=+732.677903120" watchObservedRunningTime="2026-11-03 21:42:42.713249085 +0000 UTC m=+732.680085819"
Nov 03 21:42:43.184749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:43.184718    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:52.184997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:52.184958    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:52.197350 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:52.197318    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:52.732546 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:52.732515    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:42:59.205472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.205406    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"]
Nov 03 21:42:59.208686 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.208660    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.227843 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.227807    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"]
Nov 03 21:42:59.238411 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.238380    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a6da1\"/\"premium-w5-0a6da1-kserve-self-signed-certs\""
Nov 03 21:42:59.310682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.310649    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.310875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.310700    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.310875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.310792    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q28lx\" (UniqueName: \"kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.311015 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.310885    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.311015 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.310929    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.311115 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.311024    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412101 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412061    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412314 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412123    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412314 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412163    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q28lx\" (UniqueName: \"kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412314 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412186    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412314 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412213    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412314 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412263    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.412896 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.412541    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.414879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.413017    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.414879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.413289    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.415589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.415565    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.415862 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.415845    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.432605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.432571    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q28lx\" (UniqueName: \"kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx\") pod \"premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") " pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.520610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.520535    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:42:59.827771 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:42:59.827745    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"]
Nov 03 21:42:59.829043 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:42:59.829015    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e04a239_1f27_43b1_9599_9b2c8581e4d6.slice/crio-841f08976de51542debf2bd291dad691d9d4442fdcc93e07da479b2785e7446e WatchSource:0}: Error finding container 841f08976de51542debf2bd291dad691d9d4442fdcc93e07da479b2785e7446e: Status 404 returned error can't find the container with id 841f08976de51542debf2bd291dad691d9d4442fdcc93e07da479b2785e7446e
Nov 03 21:43:00.765472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:00.765412    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" event={"ID":"1e04a239-1f27-43b1-9599-9b2c8581e4d6","Type":"ContainerStarted","Data":"06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f"}
Nov 03 21:43:00.765472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:00.765481    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" event={"ID":"1e04a239-1f27-43b1-9599-9b2c8581e4d6","Type":"ContainerStarted","Data":"841f08976de51542debf2bd291dad691d9d4442fdcc93e07da479b2785e7446e"}
Nov 03 21:43:00.806226 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:00.806169    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podStartSLOduration=1.806154788 podStartE2EDuration="1.806154788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:43:00.805327666 +0000 UTC m=+750.772164419" watchObservedRunningTime="2026-11-03 21:43:00.806154788 +0000 UTC m=+750.772991580"
Nov 03 21:43:01.397339 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:43:01.397296    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:43:01.521601 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:01.521561    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:43:09.521167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:09.521130    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:43:09.534374 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:09.534345    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:43:09.829602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:09.829520    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:43:10.341003 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.340970    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"]
Nov 03 21:43:10.343729 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.343701    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.362822 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.362795    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"]
Nov 03 21:43:10.374147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.374120    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-05bc27\"/\"premium-w4-05bc27-kserve-self-signed-certs\""
Nov 03 21:43:10.422654 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.422622    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.422654 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.422659    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.422889 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.422680    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.422889 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.422707    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghlrw\" (UniqueName: \"kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.422889 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.422775    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.423047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.422989    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524096    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524242    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524265    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524290    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524320    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlrw\" (UniqueName: \"kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524347    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524915    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.524959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.524924    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.525192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.525172    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.534312 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.534251    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.534749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.534728    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.546515 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.546450    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghlrw\" (UniqueName: \"kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw\") pod \"premium-w4-05bc27-kserve-7795444667-crv8f\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") " pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.657055 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.657018    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:10.953807 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:10.953768    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"]
Nov 03 21:43:10.954496 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:43:10.954445    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb937cb50_ba91_42b3_9a0d_acdb7bf12e87.slice/crio-f52f7235e5700f36d5e8fd1b995697b59a7cb513d792991c9bf65c4fa518f7bf WatchSource:0}: Error finding container f52f7235e5700f36d5e8fd1b995697b59a7cb513d792991c9bf65c4fa518f7bf: Status 404 returned error can't find the container with id f52f7235e5700f36d5e8fd1b995697b59a7cb513d792991c9bf65c4fa518f7bf
Nov 03 21:43:11.826866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:11.826825    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" event={"ID":"b937cb50-ba91-42b3-9a0d-acdb7bf12e87","Type":"ContainerStarted","Data":"8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a"}
Nov 03 21:43:11.827270 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:11.826881    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" event={"ID":"b937cb50-ba91-42b3-9a0d-acdb7bf12e87","Type":"ContainerStarted","Data":"f52f7235e5700f36d5e8fd1b995697b59a7cb513d792991c9bf65c4fa518f7bf"}
Nov 03 21:43:11.867831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:11.867780    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podStartSLOduration=1.8677639959999999 podStartE2EDuration="1.867763996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:43:11.86635961 +0000 UTC m=+761.833196346" watchObservedRunningTime="2026-11-03 21:43:11.867763996 +0000 UTC m=+761.834600730"
Nov 03 21:43:12.657526 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:12.657474    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:20.657379 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:20.657342    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:20.670236 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:20.670210    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:20.886372 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:20.886337    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:43:31.397859 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:43:31.397821    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:43:49.513111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.513030    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"]
Nov 03 21:43:49.515612 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.515595    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.530818 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.530794    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-517149-openshift-default-dockercfg-hr4lp\""
Nov 03 21:43:49.544147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544061    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544283 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544180    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544283 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544212    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544338    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544369    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544399    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544457    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcjxr\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544496    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.544603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.544551    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.546523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.546492    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"]
Nov 03 21:43:49.645301 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645268    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645301 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645304    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645340    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645383    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcjxr\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645456    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645527    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645837 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645601    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645837 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645629    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645837 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645669    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645837 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645719    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.645837 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645761    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.646096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.645922    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.646096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.646031    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.646211 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.646194    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.647904 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.647876    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.648209 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.648188    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.665855 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.665831    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcjxr\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.665974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.665871    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:49.827362 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:49.827282    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:50.145681 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:50.145659    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"]
Nov 03 21:43:50.147447 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:43:50.147409    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1869b1_e189_4c4a_96e9_19e7719acbb2.slice/crio-b178fe082c2eb6ec58a5af33d3283d4a590ff461713caf2e3d172f510cc398cd WatchSource:0}: Error finding container b178fe082c2eb6ec58a5af33d3283d4a590ff461713caf2e3d172f510cc398cd: Status 404 returned error can't find the container with id b178fe082c2eb6ec58a5af33d3283d4a590ff461713caf2e3d172f510cc398cd
Nov 03 21:43:50.149672 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:50.149637    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:43:50.149768 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:50.149703    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:43:50.149768 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:50.149732    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:43:51.066439 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:51.066386    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" event={"ID":"dd1869b1-e189-4c4a-96e9-19e7719acbb2","Type":"ContainerStarted","Data":"b709b572f5c7af9bef7641f3bb37558b82729abfcacaebb3a00431a1dc02f417"}
Nov 03 21:43:51.066940 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:51.066464    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" event={"ID":"dd1869b1-e189-4c4a-96e9-19e7719acbb2","Type":"ContainerStarted","Data":"b178fe082c2eb6ec58a5af33d3283d4a590ff461713caf2e3d172f510cc398cd"}
Nov 03 21:43:51.124362 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:51.124316    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podStartSLOduration=2.124303273 podStartE2EDuration="2.124303273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:43:51.12359055 +0000 UTC m=+801.090427312" watchObservedRunningTime="2026-11-03 21:43:51.124303273 +0000 UTC m=+801.091140007"
Nov 03 21:43:51.827882 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:51.827845    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:51.829376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:51.829352    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 03 21:43:51.829510 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:51.829398    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 03 21:43:52.828464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:52.828403    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 03 21:43:52.828881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:52.828490    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 03 21:43:53.828009 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:53.827971    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 03 21:43:53.828179 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:53.828024    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 03 21:43:54.828474 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:54.828414    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 03 21:43:54.828984 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:54.828493    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 03 21:43:55.828588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:55.828548    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Nov 03 21:43:55.829055 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:55.828604    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Nov 03 21:43:57.492134 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:57.492095    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:57.492659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:57.492379    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:43:57.493972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:43:57.493942    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:44:01.398461 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:44:01.398410    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:44:24.675403 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.675324    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"]
Nov 03 21:44:24.679491 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.679470    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.710995 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.710959    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-27fdf4-openshift-default-dockercfg-5cb9j\""
Nov 03 21:44:24.713382 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.713355    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"]
Nov 03 21:44:24.725215 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725186    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttwmz\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725259    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725414 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725351    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725497 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725465    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725558 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725502    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725576    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725615    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725736 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725691    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.725736 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.725728    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.807800 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.807770    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"]
Nov 03 21:44:24.811375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.811357    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.826574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826550    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.826676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826581    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.826676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826607    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.826761 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826719    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.826761 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826749    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.826831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826768    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.826831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826787    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.826831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826824    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.826953 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826840    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.826953 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.826858    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.827140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827068    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827213 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827148    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827213 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827165    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827213 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827203    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtfb\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.827365 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827213    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827365 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827227    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttwmz\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827393    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827456    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827480    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.827650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827515    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.827650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827479    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.827775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.827756    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.828116 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.828097    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.829635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.829393    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.829635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.829503    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.829635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.829601    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-4eced5-openshift-default-dockercfg-pf9dz\""
Nov 03 21:44:24.832289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.832267    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"]
Nov 03 21:44:24.847182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.847151    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.847572 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.847554    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttwmz\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:24.928331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928246    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928287    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928305    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928620 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928346    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtfb\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928620 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928400    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928620 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928565    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928633    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928663    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928709    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928717    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928986 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928782    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928986 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928899    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.928986 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.928961    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.929390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.929368    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.930667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.930650    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.931007 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.930990    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.948792 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.948768    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:24.948997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:24.948979    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtfb\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:25.023161 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.023127    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:25.124180 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.124142    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:25.359558 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.359530    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"]
Nov 03 21:44:25.361609 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:44:25.361578    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13fd7636_3776_4ffc_93b5_707a399834d4.slice/crio-9ed85034dbb931bac94e7271aa0380727512aa6195d264ca55860903fc23b10b WatchSource:0}: Error finding container 9ed85034dbb931bac94e7271aa0380727512aa6195d264ca55860903fc23b10b: Status 404 returned error can't find the container with id 9ed85034dbb931bac94e7271aa0380727512aa6195d264ca55860903fc23b10b
Nov 03 21:44:25.364030 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.363994    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:25.364122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.364062    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:25.364122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.364090    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:25.450763 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.450733    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"]
Nov 03 21:44:25.451165 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:44:25.451125    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod703634ce_d518_4b85_a5bb_31e1ac3aa8a9.slice/crio-8ba751b61d7a03a5834fb3338d96f72cbcd8c977f18aeff3dc5899da3cb50c97 WatchSource:0}: Error finding container 8ba751b61d7a03a5834fb3338d96f72cbcd8c977f18aeff3dc5899da3cb50c97: Status 404 returned error can't find the container with id 8ba751b61d7a03a5834fb3338d96f72cbcd8c977f18aeff3dc5899da3cb50c97
Nov 03 21:44:25.453903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.453867    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:25.453980 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.453934    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:25.453980 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:25.453961    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:26.295166 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:26.295127    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" event={"ID":"13fd7636-3776-4ffc-93b5-707a399834d4","Type":"ContainerStarted","Data":"d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7"}
Nov 03 21:44:26.296023 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:26.295994    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" event={"ID":"13fd7636-3776-4ffc-93b5-707a399834d4","Type":"ContainerStarted","Data":"9ed85034dbb931bac94e7271aa0380727512aa6195d264ca55860903fc23b10b"}
Nov 03 21:44:26.299053 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:26.299021    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" event={"ID":"703634ce-d518-4b85-a5bb-31e1ac3aa8a9","Type":"ContainerStarted","Data":"4a20fe365df496aa03d44f2ec82828a220af80fe866ac40de6e76fbeacb4aea0"}
Nov 03 21:44:26.299985 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:26.299955    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" event={"ID":"703634ce-d518-4b85-a5bb-31e1ac3aa8a9","Type":"ContainerStarted","Data":"8ba751b61d7a03a5834fb3338d96f72cbcd8c977f18aeff3dc5899da3cb50c97"}
Nov 03 21:44:26.417448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:26.416154    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podStartSLOduration=2.416131894 podStartE2EDuration="2.416131894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:26.413930859 +0000 UTC m=+836.380767595" watchObservedRunningTime="2026-11-03 21:44:26.416131894 +0000 UTC m=+836.382968630"
Nov 03 21:44:26.424413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:26.422873    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podStartSLOduration=2.422852344 podStartE2EDuration="2.422852344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:26.354819165 +0000 UTC m=+836.321655930" watchObservedRunningTime="2026-11-03 21:44:26.422852344 +0000 UTC m=+836.389689080"
Nov 03 21:44:27.024092 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:27.024058    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:27.026361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:27.026329    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 03 21:44:27.026506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:27.026384    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 03 21:44:27.124932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:27.124903    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:27.126845 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:27.126813    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 03 21:44:27.126976 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:27.126875    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 03 21:44:28.025454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.024841    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 03 21:44:28.025454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.024908    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 03 21:44:28.125669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.124976    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 03 21:44:28.125669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.125055    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 03 21:44:28.559583 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.558525    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:28.603448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.602512    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:28.644159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.643543    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Nov 03 21:44:28.674305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.673242    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:28.747479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.746807    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:28.847949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.846586    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:28.889587 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:28.888512    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:29.026447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.025825    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 03 21:44:29.026447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.025891    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 03 21:44:29.127506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.126878    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 03 21:44:29.127506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.126947    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 03 21:44:29.561580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.561469    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Nov 03 21:44:29.562268 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.562243    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:44:29.606589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.606539    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:29.607317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.607264    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:44:29.705091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.705037    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:29.705749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.705726    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:44:29.756447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.725789    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 03 21:44:29.773445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.756773    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:29.773445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.759025    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:44:29.773445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.759132    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:44:29.892473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.888499    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:29.892473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:29.888942    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:44:30.115866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.115821    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 03 21:44:30.285348 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.285251    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 03 21:44:30.285677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.202598    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:30.394447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.384511    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/health\": context deadline exceeded"
Nov 03 21:44:30.456512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.387517    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 03 21:44:30.456512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.450575    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 03 21:44:30.456813 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.391055    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:44:30.626483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.625543    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:30.626778 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.626531    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:44:30.665741 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.665709    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:44:30.666044 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.666024    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:44:30.720748 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.720716    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:44:30.748503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.723881    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:44:30.748503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.723956    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:44:30.748503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.735505    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:44:30.825675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:30.825650    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:44:31.023869 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:31.023794    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 03 21:44:31.024026 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:31.023864    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 03 21:44:31.125821 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:31.125787    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 03 21:44:31.126317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:31.125854    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 03 21:44:31.413613 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:44:31.413488    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:44:32.023839 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:32.023787    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Nov 03 21:44:32.024034 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:32.023917    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Nov 03 21:44:32.125507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:32.125473    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Nov 03 21:44:32.125706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:32.125531    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Nov 03 21:44:33.028225 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:33.028196    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:33.028688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:33.028626    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:33.029305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:33.029285    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:44:33.129190 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:33.129157    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:33.130316 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:33.129751    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:33.131031 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:33.131012    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:44:34.598621 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.598588    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"]
Nov 03 21:44:34.602263 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.602241    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.619357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.619330    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"]
Nov 03 21:44:34.630301 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.630274    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 21:44:34.630539 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.630503    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:44:34.763143 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.763104    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.763305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.763169    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.763305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.763264    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcnn\" (UniqueName: \"kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.864535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.864464    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.864535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.864517    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.864704 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.864546    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcnn\" (UniqueName: \"kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.865232 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.865209    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.866937 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.866916    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.884361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.884327    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcnn\" (UniqueName: \"kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn\") pod \"maas-api-revoke-sub-ba8353c4-hltps\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:34.915038 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:34.915002    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:35.215469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:35.215437    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"]
Nov 03 21:44:35.216318 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:44:35.216284    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e31966_01c3_4129_a86e_5c35923a2f64.slice/crio-e4ecf1753a184589f8a773a57e816df53d6d03a710cf63295d0ef28381f9fa7d WatchSource:0}: Error finding container e4ecf1753a184589f8a773a57e816df53d6d03a710cf63295d0ef28381f9fa7d: Status 404 returned error can't find the container with id e4ecf1753a184589f8a773a57e816df53d6d03a710cf63295d0ef28381f9fa7d
Nov 03 21:44:35.772015 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:35.771976    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps" event={"ID":"35e31966-01c3-4129-a86e-5c35923a2f64","Type":"ContainerStarted","Data":"e4ecf1753a184589f8a773a57e816df53d6d03a710cf63295d0ef28381f9fa7d"}
Nov 03 21:44:36.456581 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.456540    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"]
Nov 03 21:44:36.461098 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.461072    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.480996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.480966    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"]
Nov 03 21:44:36.483270 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.483246    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.483397 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.483385    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncskk\" (UniqueName: \"kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.483502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.483481    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.483578 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.483547    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.483682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.483666    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.483740 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.483702    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.492407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.492361    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-dd5620\"/\"default-dockercfg-mwz2f\""
Nov 03 21:44:36.492407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.492392    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-dd5620\"/\"kube-root-ca.crt\""
Nov 03 21:44:36.492407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.492392    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-dd5620\"/\"openshift-service-ca.crt\""
Nov 03 21:44:36.492650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.492507    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-dd5620\"/\"distinct-w3-dd5620-kserve-self-signed-certs\""
Nov 03 21:44:36.584842 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.584804    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.585010 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.584889    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.585010 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.584976    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.585096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.585016    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.585096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.585066    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.585204 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.585186    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncskk\" (UniqueName: \"kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.586009 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.585987    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.587195 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.586708    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.587195 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.587154    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.588755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.588729    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.591663 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.591640    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.605727 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.605700    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncskk\" (UniqueName: \"kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk\") pod \"distinct-w3-dd5620-kserve-78cf99ff-nljtx\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") " pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:36.777122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:36.777036    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:37.095862 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:37.095821    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"]
Nov 03 21:44:37.095993 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:44:37.095833    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd763424_4f56_483d_83ae_0f28d65ed8b8.slice/crio-f7dd5d345996d8ab7670069ea9466c90dc7173a1e34ca4de8ec8712a3427917c WatchSource:0}: Error finding container f7dd5d345996d8ab7670069ea9466c90dc7173a1e34ca4de8ec8712a3427917c: Status 404 returned error can't find the container with id f7dd5d345996d8ab7670069ea9466c90dc7173a1e34ca4de8ec8712a3427917c
Nov 03 21:44:37.785901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:37.785863    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps" event={"ID":"35e31966-01c3-4129-a86e-5c35923a2f64","Type":"ContainerStarted","Data":"b330255d37715e4e0042457afcd8b7ec5449bb828f0576fb9f6cf61dbe085015"}
Nov 03 21:44:37.787479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:37.787451    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" event={"ID":"cd763424-4f56-483d-83ae-0f28d65ed8b8","Type":"ContainerStarted","Data":"b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b"}
Nov 03 21:44:37.787628 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:37.787489    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" event={"ID":"cd763424-4f56-483d-83ae-0f28d65ed8b8","Type":"ContainerStarted","Data":"f7dd5d345996d8ab7670069ea9466c90dc7173a1e34ca4de8ec8712a3427917c"}
Nov 03 21:44:37.826066 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:37.826014    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps" podStartSLOduration=1.612513715 podStartE2EDuration="3.826001995s" totalImagesPullingTime="2.21348828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:37.825458961 +0000 UTC m=+847.792295685" watchObservedRunningTime="2026-11-03 21:44:37.826001995 +0000 UTC m=+847.792838773"
Nov 03 21:44:37.867083 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:37.867031    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podStartSLOduration=1.867015822 podStartE2EDuration="1.867015822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:37.864939752 +0000 UTC m=+847.831776511" watchObservedRunningTime="2026-11-03 21:44:37.867015822 +0000 UTC m=+847.833852555"
Nov 03 21:44:38.777714 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:38.777686    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:38.795874 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:38.795843    6774 generic.go:356] "Generic (PLEG): container finished" podID="35e31966-01c3-4129-a86e-5c35923a2f64" containerID="b330255d37715e4e0042457afcd8b7ec5449bb828f0576fb9f6cf61dbe085015" exitCode=0
Nov 03 21:44:38.796227 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:38.795920    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps" event={"ID":"35e31966-01c3-4129-a86e-5c35923a2f64","Type":"ContainerDied","Data":"b330255d37715e4e0042457afcd8b7ec5449bb828f0576fb9f6cf61dbe085015"}
Nov 03 21:44:39.954609 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:39.954584    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:40.021880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.021839    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca\") pod \"35e31966-01c3-4129-a86e-5c35923a2f64\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") "
Nov 03 21:44:40.022069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.021916    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn\" (UniqueName: \"kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn\") pod \"35e31966-01c3-4129-a86e-5c35923a2f64\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") "
Nov 03 21:44:40.022069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.021980    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca\") pod \"35e31966-01c3-4129-a86e-5c35923a2f64\" (UID: \"35e31966-01c3-4129-a86e-5c35923a2f64\") "
Nov 03 21:44:40.022882 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.022835    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca" pod "35e31966-01c3-4129-a86e-5c35923a2f64" (UID: "35e31966-01c3-4129-a86e-5c35923a2f64"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:44:40.024775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.024713    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca" pod "35e31966-01c3-4129-a86e-5c35923a2f64" (UID: "35e31966-01c3-4129-a86e-5c35923a2f64"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:44:40.025927 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.025907    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn" pod "35e31966-01c3-4129-a86e-5c35923a2f64" (UID: "35e31966-01c3-4129-a86e-5c35923a2f64"). InnerVolumeSpecName "kube-api-access-9pcnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:44:40.123473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.123409    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:44:40.123473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.123470    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pcnn\" (UniqueName: \"kubernetes.io/projected/35e31966-01c3-4129-a86e-5c35923a2f64-kube-api-access-9pcnn\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:44:40.123683 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.123481    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/35e31966-01c3-4129-a86e-5c35923a2f64-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:44:40.808579 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.808550    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"
Nov 03 21:44:40.808751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.808587    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps" event={"ID":"35e31966-01c3-4129-a86e-5c35923a2f64","Type":"ContainerDied","Data":"e4ecf1753a184589f8a773a57e816df53d6d03a710cf63295d0ef28381f9fa7d"}
Nov 03 21:44:40.808751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:40.808634    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4ecf1753a184589f8a773a57e816df53d6d03a710cf63295d0ef28381f9fa7d"
Nov 03 21:44:46.777395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:46.777358    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:46.790251 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:46.790226    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:46.857341 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:46.857313    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:44:55.115097 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.115066    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"]
Nov 03 21:44:55.115556 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.115547    6774 cpu_manager.go:414] "containerMap: removing container" podUID="35e31966-01c3-4129-a86e-5c35923a2f64" containerName="revoke-keys"
Nov 03 21:44:55.115603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.115559    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35e31966-01c3-4129-a86e-5c35923a2f64" containerName="revoke-keys"
Nov 03 21:44:55.115658 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.115648    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="35e31966-01c3-4129-a86e-5c35923a2f64" containerName="revoke-keys"
Nov 03 21:44:55.118902 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.118885    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.138209 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.138180    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-05bc27-openshift-default-dockercfg-bxn7k\""
Nov 03 21:44:55.154131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.154098    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"]
Nov 03 21:44:55.213261 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213213    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213340    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213388    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213440    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213493    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlf4t\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213552    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213651 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213589    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213709 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213695    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.213744 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.213734    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314590    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314659    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314711    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314735    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlf4t\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314782    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314822    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314877    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314930    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.314992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.314973    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.315193 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.315044    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.315253 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.315220    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.315320 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.315295    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.315472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.315447    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.315532 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.315482    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.316990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.316960    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.317338 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.317321    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.334764 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.334741    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlf4t\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.334888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.334776    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.431669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.431595    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:55.744403 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.744378    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"]
Nov 03 21:44:55.745633 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:44:55.745607    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3171c4_cfc7_4bb2_88f2_71a479c3c31a.slice/crio-5f6974ac2aed92133daa61b9b228bc5edb6c8c5549d15fb1cac892d5ab7e88ba WatchSource:0}: Error finding container 5f6974ac2aed92133daa61b9b228bc5edb6c8c5549d15fb1cac892d5ab7e88ba: Status 404 returned error can't find the container with id 5f6974ac2aed92133daa61b9b228bc5edb6c8c5549d15fb1cac892d5ab7e88ba
Nov 03 21:44:55.748572 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.748540    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:55.748687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.748604    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:55.748687 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.748631    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:44:55.897114 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.897072    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" event={"ID":"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a","Type":"ContainerStarted","Data":"267192e2cd3eca58d0ffca623b8d0642dd0c8b032876a8fe5ea041eb96f12e3a"}
Nov 03 21:44:55.897283 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.897137    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" event={"ID":"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a","Type":"ContainerStarted","Data":"5f6974ac2aed92133daa61b9b228bc5edb6c8c5549d15fb1cac892d5ab7e88ba"}
Nov 03 21:44:55.945167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:55.945116    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podStartSLOduration=0.945101867 podStartE2EDuration="945.101867ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:44:55.942336072 +0000 UTC m=+865.909172818" watchObservedRunningTime="2026-11-03 21:44:55.945101867 +0000 UTC m=+865.911938601"
Nov 03 21:44:56.432188 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:56.432157    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:44:56.433484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:56.433459    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 03 21:44:56.433605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:56.433521    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 03 21:44:57.432683 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:57.432645    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 03 21:44:57.433156 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:57.432697    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 03 21:44:58.432761 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:58.432727    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 03 21:44:58.433150 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:58.432781    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 03 21:44:59.432226 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:59.432192    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 03 21:44:59.432397 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:44:59.432250    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 03 21:45:00.168707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.168673    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"]
Nov 03 21:45:00.173694 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.173657    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.174462 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.174436    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"]
Nov 03 21:45:00.179386 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.178735    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"]
Nov 03 21:45:00.181001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.180977    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.184579 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.183713    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.188334 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.188308    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"]
Nov 03 21:45:00.201198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.201170    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.202092 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.202066    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khmr5\" (UniqueName: \"kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5\") pod \"maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.202974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.202955    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw8rm\" (UniqueName: \"kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm\") pod \"maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.203216 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.203198    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms48x\" (UniqueName: \"kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x\") pod \"maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.205649 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.205332    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.206139 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.206118    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.209608 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.209491    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"]
Nov 03 21:45:00.223442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.221491    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"]
Nov 03 21:45:00.280864 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.280829    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:45:00.308395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.308347    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.308706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.308679    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khmr5\" (UniqueName: \"kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5\") pod \"maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.308809 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.308797    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw8rm\" (UniqueName: \"kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm\") pod \"maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.308927 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.308917    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms48x\" (UniqueName: \"kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x\") pod \"maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.309088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.309078    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.309190 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.309181    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.309338 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.309078    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.309643 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.309625    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.309943 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.309923    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.333157 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.333128    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw8rm\" (UniqueName: \"kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm\") pod \"maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.333352 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.333203    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khmr5\" (UniqueName: \"kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5\") pod \"maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.335675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.335652    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms48x\" (UniqueName: \"kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x\") pod \"maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.432583 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.432497    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 03 21:45:00.432583 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.432549    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 03 21:45:00.504382 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.504349    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:00.534754 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.533627    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:00.535356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.535303    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:00.840449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.836859    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"]
Nov 03 21:45:00.911572 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.911544    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"]
Nov 03 21:45:00.912558 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:00.912531    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fa144b_e7fd_4bfc_aba8_3f3112adc882.slice/crio-2c9c10be21d01b2bc444859f8811b7ac92c13e8f86c87dca4e6422f719413099 WatchSource:0}: Error finding container 2c9c10be21d01b2bc444859f8811b7ac92c13e8f86c87dca4e6422f719413099: Status 404 returned error can't find the container with id 2c9c10be21d01b2bc444859f8811b7ac92c13e8f86c87dca4e6422f719413099
Nov 03 21:45:00.924679 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.924656    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"]
Nov 03 21:45:00.926519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.926486    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerStarted","Data":"2c9c10be21d01b2bc444859f8811b7ac92c13e8f86c87dca4e6422f719413099"}
Nov 03 21:45:00.928703 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:00.928674    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerStarted","Data":"f5432847d3f29de8be3106d2fef106f4c837f8e76dfa10ff177509f3ed3fd9f8"}
Nov 03 21:45:01.403404 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:01.403353    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:45:01.433403 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.433369    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Nov 03 21:45:01.433609 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.433441    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Nov 03 21:45:01.936742 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.936695    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerStarted","Data":"8e587e3636d019b89083d136f2e533b6a16ac7401ca1cde27dcd5de0f1f27096"}
Nov 03 21:45:01.939781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.939757    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerStarted","Data":"3cf2ec7b3d0f601751f210ac3fd8c40f8b68ecbef7b836d3325a9b2abe4f6b23"}
Nov 03 21:45:01.941589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.941555    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerStarted","Data":"2b3e78321ec25f61bbc0bf5a767f6f67ebacf51cd08375074c247ff3cef292e3"}
Nov 03 21:45:01.941719 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.941613    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerStarted","Data":"d4975d266b7f873e6ef910acf7a55c826653a9a0a3976f536d5cb22c6cee791c"}
Nov 03 21:45:01.975651 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:01.975591    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" podStartSLOduration=1.975576132 podStartE2EDuration="1.975576132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:01.974796689 +0000 UTC m=+871.941633442" watchObservedRunningTime="2026-11-03 21:45:01.975576132 +0000 UTC m=+871.942412891"
Nov 03 21:45:02.051789 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.051733    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" podStartSLOduration=2.051716699 podStartE2EDuration="2.051716699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:02.049026961 +0000 UTC m=+872.015863715" watchObservedRunningTime="2026-11-03 21:45:02.051716699 +0000 UTC m=+872.018553471"
Nov 03 21:45:02.100359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.100295    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" podStartSLOduration=2.100280523 podStartE2EDuration="2.100280523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:02.099323025 +0000 UTC m=+872.066159785" watchObservedRunningTime="2026-11-03 21:45:02.100280523 +0000 UTC m=+872.067117257"
Nov 03 21:45:02.950585 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.950540    6774 generic.go:356] "Generic (PLEG): container finished" podID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerID="8e587e3636d019b89083d136f2e533b6a16ac7401ca1cde27dcd5de0f1f27096" exitCode=60
Nov 03 21:45:02.950996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.950639    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerDied","Data":"8e587e3636d019b89083d136f2e533b6a16ac7401ca1cde27dcd5de0f1f27096"}
Nov 03 21:45:02.951088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.951069    6774 scope.go:122] "RemoveContainer" containerID="8e587e3636d019b89083d136f2e533b6a16ac7401ca1cde27dcd5de0f1f27096"
Nov 03 21:45:02.954651 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.954626    6774 generic.go:356] "Generic (PLEG): container finished" podID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerID="3cf2ec7b3d0f601751f210ac3fd8c40f8b68ecbef7b836d3325a9b2abe4f6b23" exitCode=60
Nov 03 21:45:02.954773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.954753    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerDied","Data":"3cf2ec7b3d0f601751f210ac3fd8c40f8b68ecbef7b836d3325a9b2abe4f6b23"}
Nov 03 21:45:02.955059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.955040    6774 scope.go:122] "RemoveContainer" containerID="3cf2ec7b3d0f601751f210ac3fd8c40f8b68ecbef7b836d3325a9b2abe4f6b23"
Nov 03 21:45:02.957470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.957402    6774 generic.go:356] "Generic (PLEG): container finished" podID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerID="2b3e78321ec25f61bbc0bf5a767f6f67ebacf51cd08375074c247ff3cef292e3" exitCode=60
Nov 03 21:45:02.957470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.957464    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerDied","Data":"2b3e78321ec25f61bbc0bf5a767f6f67ebacf51cd08375074c247ff3cef292e3"}
Nov 03 21:45:02.957830 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:02.957808    6774 scope.go:122] "RemoveContainer" containerID="2b3e78321ec25f61bbc0bf5a767f6f67ebacf51cd08375074c247ff3cef292e3"
Nov 03 21:45:03.300358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.300322    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:45:03.301242 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.301211    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:45:03.301899 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.301872    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:45:03.965009 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.964976    6774 generic.go:356] "Generic (PLEG): container finished" podID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerID="d048ffa62cda49eed16ba37735d86ec03c7fd53eb4b878acb16014b82fa23052" exitCode=60
Nov 03 21:45:03.965408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.965061    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerDied","Data":"d048ffa62cda49eed16ba37735d86ec03c7fd53eb4b878acb16014b82fa23052"}
Nov 03 21:45:03.965408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.965129    6774 scope.go:122] "RemoveContainer" containerID="8e587e3636d019b89083d136f2e533b6a16ac7401ca1cde27dcd5de0f1f27096"
Nov 03 21:45:03.965408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.965320    6774 scope.go:122] "RemoveContainer" containerID="d048ffa62cda49eed16ba37735d86ec03c7fd53eb4b878acb16014b82fa23052"
Nov 03 21:45:03.965705 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:03.965668    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj_odh-ai-gateway-infra(59fa144b-e7fd-4bfc-aba8-3f3112adc882)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882"
Nov 03 21:45:03.967032 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.967012    6774 generic.go:356] "Generic (PLEG): container finished" podID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerID="c6f144dd43ea1f5af49559f314af68ddfc23372fe6445f3fa7c23ffa1133ee59" exitCode=60
Nov 03 21:45:03.967133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.967085    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerDied","Data":"c6f144dd43ea1f5af49559f314af68ddfc23372fe6445f3fa7c23ffa1133ee59"}
Nov 03 21:45:03.967376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.967359    6774 scope.go:122] "RemoveContainer" containerID="c6f144dd43ea1f5af49559f314af68ddfc23372fe6445f3fa7c23ffa1133ee59"
Nov 03 21:45:03.967616 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:03.967591    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x_odh-ai-gateway-infra(16b4a2a7-3e2c-44fa-8ae9-57537401e340)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340"
Nov 03 21:45:03.969072 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.969047    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerStarted","Data":"25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0"}
Nov 03 21:45:03.996477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:03.996458    6774 scope.go:122] "RemoveContainer" containerID="3cf2ec7b3d0f601751f210ac3fd8c40f8b68ecbef7b836d3325a9b2abe4f6b23"
Nov 03 21:45:04.977704 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:04.977675    6774 scope.go:122] "RemoveContainer" containerID="d048ffa62cda49eed16ba37735d86ec03c7fd53eb4b878acb16014b82fa23052"
Nov 03 21:45:04.978128 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:04.977991    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj_odh-ai-gateway-infra(59fa144b-e7fd-4bfc-aba8-3f3112adc882)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882"
Nov 03 21:45:04.979341 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:04.979319    6774 scope.go:122] "RemoveContainer" containerID="c6f144dd43ea1f5af49559f314af68ddfc23372fe6445f3fa7c23ffa1133ee59"
Nov 03 21:45:04.979609 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:04.979588    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x_odh-ai-gateway-infra(16b4a2a7-3e2c-44fa-8ae9-57537401e340)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340"
Nov 03 21:45:04.981355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:04.981331    6774 generic.go:356] "Generic (PLEG): container finished" podID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerID="25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0" exitCode=60
Nov 03 21:45:04.981479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:04.981415    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerDied","Data":"25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0"}
Nov 03 21:45:04.981543 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:04.981535    6774 scope.go:122] "RemoveContainer" containerID="2b3e78321ec25f61bbc0bf5a767f6f67ebacf51cd08375074c247ff3cef292e3"
Nov 03 21:45:04.981627 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:04.981611    6774 scope.go:122] "RemoveContainer" containerID="25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0"
Nov 03 21:45:04.981868 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:04.981845    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz_odh-ai-gateway-infra(a3a5cd1d-6c78-477d-8ce7-a87f8b092505)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505"
Nov 03 21:45:05.990123 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:05.990094    6774 scope.go:122] "RemoveContainer" containerID="25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0"
Nov 03 21:45:05.990531 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:05.990408    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz_odh-ai-gateway-infra(a3a5cd1d-6c78-477d-8ce7-a87f8b092505)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505"
Nov 03 21:45:09.806979 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.806943    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"]
Nov 03 21:45:09.812515 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.812491    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.859453 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.859405    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"]
Nov 03 21:45:09.926230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926196    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926409 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926244    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926409 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926263    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926409 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926390    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwld\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926568 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926491    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926568 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926564    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926587    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926753    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.926921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.926793    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:09.961446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.961180    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"]
Nov 03 21:45:09.999472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:09.998046    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.010111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.010050    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"]
Nov 03 21:45:10.028293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028238    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028492 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028311    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028492 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028365    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028492 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028407    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028527    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028562    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028587    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028633    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwld\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.028865 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.028699    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.029229 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.029132    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.030823 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.029799    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.030823 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.030448    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.032019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.031997    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.032178 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.032147    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.035160 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.035136    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.035267 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.035244    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.065511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.064589    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.065511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.064692    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwld\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.080533 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.080492    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"]
Nov 03 21:45:10.087964 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.087940    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.128990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.125118    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:10.128990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.125510    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"]
Nov 03 21:45:10.130225 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130195    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.130566 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130541    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.130743 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130726    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.130894 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130874    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.130974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130909    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.130974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130942    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.130994    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131043    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131079    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131101    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131129    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131157    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131187    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131475    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131629    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.131688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131673    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.132169 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131720    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zprl\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.132169 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.131760    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf5q9\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.174616 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.174581    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-e246f9-openshift-default-dockercfg-vn7bt\""
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.233987    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf5q9\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234040    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234069    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234091    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234110    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234128    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234151    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234183    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234214    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234236    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234253    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234268    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234285    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234304    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234342    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234392    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234437    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.234774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234487    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zprl\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.235405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234928    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.235405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.234945    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.235405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.235376    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.236017    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.236086    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.236276    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.236637    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.237035    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.237041    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.237124    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.238996    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.239950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.239508    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.240579 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.240338    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.241903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.241847    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.255147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.255105    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.255935 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.255883    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.257126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.256246    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf5q9\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.257126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.256592    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zprl\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.322478 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.322379    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:10.432843 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.432812    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:10.467746 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.467710    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"]
Nov 03 21:45:10.468565 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:10.468542    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916ee91f_15b0_43c9_922c_4feff20ad29d.slice/crio-5bc74b531e7aa8a4163deb64425b105b787b2c89e2a66d8f21988756912cd188 WatchSource:0}: Error finding container 5bc74b531e7aa8a4163deb64425b105b787b2c89e2a66d8f21988756912cd188: Status 404 returned error can't find the container with id 5bc74b531e7aa8a4163deb64425b105b787b2c89e2a66d8f21988756912cd188
Nov 03 21:45:10.471084 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.471049    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.471178 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.471130    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.471233 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.471176    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.565799 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.565764    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"]
Nov 03 21:45:10.569946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.569926    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.591093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.590942    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-dd5620-openshift-default-dockercfg-cm274\""
Nov 03 21:45:10.591592 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.591569    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"]
Nov 03 21:45:10.644396 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644351    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644404    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644450    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644481    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644513    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644544    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644609    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644632    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htblf\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.644828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.644659    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.646375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.646349    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"]
Nov 03 21:45:10.650642 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:10.650617    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04fb47d8_e3be_4f54_b8df_ca78c4a5bb3c.slice/crio-d116e7648d17c538303bd905c924caef0fd5624679b8dfa5effd257295f10062 WatchSource:0}: Error finding container d116e7648d17c538303bd905c924caef0fd5624679b8dfa5effd257295f10062: Status 404 returned error can't find the container with id d116e7648d17c538303bd905c924caef0fd5624679b8dfa5effd257295f10062
Nov 03 21:45:10.653583 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.653538    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.653679 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.653626    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.653738 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.653675    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.745682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745658    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.745798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745704    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.745798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745756    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.745925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745797    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.745925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745845    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.745925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745901    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.746074 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.745952    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.746074 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.746050    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.746192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.746135    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.746192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.746175    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htblf\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.747652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.747112    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.747652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.747247    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.747652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.747371    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.747652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.747599    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.752657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.752630    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.752868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.752844    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.753619 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:10.753575    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc74c68_4ad1_49b8_80d6_3d74d9a1cf55.slice/crio-7272de503aa414b2a99707c57306900da8c54b0dfdb76f57c61453b76c064bc7 WatchSource:0}: Error finding container 7272de503aa414b2a99707c57306900da8c54b0dfdb76f57c61453b76c064bc7: Status 404 returned error can't find the container with id 7272de503aa414b2a99707c57306900da8c54b0dfdb76f57c61453b76c064bc7
Nov 03 21:45:10.755944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.755551    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.755944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.755623    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.755944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.755653    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:10.755944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.755819    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"]
Nov 03 21:45:10.767877 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.767852    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htblf\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.768200 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.768173    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:10.891123 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:10.890735    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:11.040144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.039105    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" event={"ID":"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c","Type":"ContainerStarted","Data":"9ae5e3e2d023be0f04d7e29b6680ae43edbb146cbf50a97061a731cfaf0d432d"}
Nov 03 21:45:11.040144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.039177    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" event={"ID":"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c","Type":"ContainerStarted","Data":"d116e7648d17c538303bd905c924caef0fd5624679b8dfa5effd257295f10062"}
Nov 03 21:45:11.043485 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.042779    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" event={"ID":"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55","Type":"ContainerStarted","Data":"23f2a60dad10410f8fd891b8be135ab542e5a29d056351152e4f44b77761065b"}
Nov 03 21:45:11.043485 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.042826    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" event={"ID":"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55","Type":"ContainerStarted","Data":"7272de503aa414b2a99707c57306900da8c54b0dfdb76f57c61453b76c064bc7"}
Nov 03 21:45:11.045941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.045921    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" event={"ID":"916ee91f-15b0-43c9-922c-4feff20ad29d","Type":"ContainerStarted","Data":"2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454"}
Nov 03 21:45:11.046642 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.046622    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" event={"ID":"916ee91f-15b0-43c9-922c-4feff20ad29d","Type":"ContainerStarted","Data":"5bc74b531e7aa8a4163deb64425b105b787b2c89e2a66d8f21988756912cd188"}
Nov 03 21:45:11.089016 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.088902    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podStartSLOduration=2.088885392 podStartE2EDuration="2.088885392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:11.085940232 +0000 UTC m=+881.052776987" watchObservedRunningTime="2026-11-03 21:45:11.088885392 +0000 UTC m=+881.055722128"
Nov 03 21:45:11.126012 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.125945    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:11.131064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.128028    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:11.131064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.128085    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:11.132245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.132180    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podStartSLOduration=2.132162592 podStartE2EDuration="2.132162592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:11.128514162 +0000 UTC m=+881.095350896" watchObservedRunningTime="2026-11-03 21:45:11.132162592 +0000 UTC m=+881.098999327"
Nov 03 21:45:11.170700 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.170644    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podStartSLOduration=1.1706261279999999 podStartE2EDuration="1.170626128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:11.169606535 +0000 UTC m=+881.136443271" watchObservedRunningTime="2026-11-03 21:45:11.170626128 +0000 UTC m=+881.137462863"
Nov 03 21:45:11.260144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.260099    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"]
Nov 03 21:45:11.265952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.265873    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:11.266194 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.266169    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:11.266283 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.266226    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:11.323229 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.323196    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:11.324756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.324734    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:11.324849 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.324787    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:11.434970 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.434893    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:11.435726 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.435699    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:11.435925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:11.435900    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:12.086455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.086379    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" event={"ID":"aa18ab08-a905-4430-ac47-373798ebf7f7","Type":"ContainerStarted","Data":"7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3"}
Nov 03 21:45:12.088403 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.088373    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" event={"ID":"aa18ab08-a905-4430-ac47-373798ebf7f7","Type":"ContainerStarted","Data":"93c69d23147d2dbc83fa05e97a7ddcc7a7e4b8795fa9f8451bd734ec0049397c"}
Nov 03 21:45:12.127925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.127890    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:12.128121 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.128064    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:12.183454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.148394    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podStartSLOduration=2.148374888 podStartE2EDuration="2.148374888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:12.144982102 +0000 UTC m=+882.111818859" watchObservedRunningTime="2026-11-03 21:45:12.148374888 +0000 UTC m=+882.115211623"
Nov 03 21:45:12.328313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.324007    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:12.328313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.324087    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:12.434299 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.433853    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:12.434299 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.433918    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:12.893395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.893362    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:12.893906 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.893886    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:12.894038 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:12.894017    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:13.126925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.126885    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:13.139624 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.139571    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:13.531445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.523804    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:13.536448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.531727    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:13.598341 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.594053    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:13.598341 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.594109    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:13.739050 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.737521    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:13.894448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.891667    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:13.896553 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.896522    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:13.896758 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:13.896735    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:14.141469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.130600    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:14.141469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.130655    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:14.322950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.322852    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:14.323212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.323181    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:14.433751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.433702    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:14.434044 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.434015    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:14.529676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.528936    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:14.728189 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.728030    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:14.898448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.897933    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:14.898448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:14.897999    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:15.143959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.139741    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:15.143959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.139814    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:15.322881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.322838    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:15.323166 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.323134    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:15.436499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.435784    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:15.436499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.435842    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:15.632446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.631534    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:15.728503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.727959    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:15.851446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.850509    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:15.901446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.891836    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:15.901446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:15.891899    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:16.150496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.137748    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:16.150496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.137911    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:16.336453 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.322796    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:16.336453 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.322860    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:16.442800 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.442698    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:16.443091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.443060    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:16.638447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.632936    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Nov 03 21:45:16.638447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.633722    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:45:16.728613 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.728504    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:16.729216 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.728843    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:16.734441 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.730506    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:45:16.771444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.770795    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:16.928457 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.926742    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:16.928457 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:16.926804    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:17.127904 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.127864    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:17.128195 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.128165    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:17.156126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.156095    6774 scope.go:122] "RemoveContainer" containerID="c6f144dd43ea1f5af49559f314af68ddfc23372fe6445f3fa7c23ffa1133ee59"
Nov 03 21:45:17.157635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.157612    6774 scope.go:122] "RemoveContainer" containerID="d048ffa62cda49eed16ba37735d86ec03c7fd53eb4b878acb16014b82fa23052"
Nov 03 21:45:17.158503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.158485    6774 scope.go:122] "RemoveContainer" containerID="25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0"
Nov 03 21:45:17.342030 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.342000    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:17.342247 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.342217    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:17.444445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.435095    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:17.444445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.435166    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:17.467652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.458677    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:17.545466 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.534513    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:17.636639 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.636577    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:17.733449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.731926    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:17.733449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.731926    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:17.767448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.754104    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:45:17.796517 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.790100    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:17.796517 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.790574    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 21:45:17.796517 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.790909    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:45:17.937705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.928697    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:17.937705 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:17.928745    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:18.184445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.179380    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:18.184445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.179461    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:18.317477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.308177    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerStarted","Data":"091e207a4ab3674fc584338d4ee13c78970303b8ab470c3f130b52059acf23fa"}
Nov 03 21:45:18.317477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.314880    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerStarted","Data":"fb87a3b3fd484d26589a7722144ee7ce9a2ed747c81c0ae3568af209428d0690"}
Nov 03 21:45:18.328444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.319115    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerStarted","Data":"20b6cd1a3a681dd863570ca461e6d0c1311e5428d23f692f03abe759468ebee1"}
Nov 03 21:45:18.328444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.323785    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Nov 03 21:45:18.328444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.323853    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Nov 03 21:45:18.346985 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.346953    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:45:18.430443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.427034    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:45:18.451505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.435122    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:18.451505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.435193    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:18.464503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.462122    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Nov 03 21:45:18.464503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.462551    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:45:18.779643 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.779600    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:45:18.792110 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.792073    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 21:45:18.895075 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.895042    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:18.895798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.895323    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:18.896576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:18.896513    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:45:19.128836 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.128794    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Nov 03 21:45:19.129028 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.128859    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Nov 03 21:45:19.155093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.155000    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:45:19.160964 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.160936    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:45:19.334442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.334351    6774 generic.go:356] "Generic (PLEG): container finished" podID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerID="091e207a4ab3674fc584338d4ee13c78970303b8ab470c3f130b52059acf23fa" exitCode=60
Nov 03 21:45:19.334915 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.334519    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerDied","Data":"091e207a4ab3674fc584338d4ee13c78970303b8ab470c3f130b52059acf23fa"}
Nov 03 21:45:19.334915 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.334582    6774 scope.go:122] "RemoveContainer" containerID="25260a58c70463a2b4c9338cc02e6b90fe98716028eb6799e2fee687c94f10c0"
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.335049    6774 scope.go:122] "RemoveContainer" containerID="091e207a4ab3674fc584338d4ee13c78970303b8ab470c3f130b52059acf23fa"
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:19.335389    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz_odh-ai-gateway-infra(a3a5cd1d-6c78-477d-8ce7-a87f8b092505)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505"
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.340629    6774 generic.go:356] "Generic (PLEG): container finished" podID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerID="fb87a3b3fd484d26589a7722144ee7ce9a2ed747c81c0ae3568af209428d0690" exitCode=60
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.340742    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerDied","Data":"fb87a3b3fd484d26589a7722144ee7ce9a2ed747c81c0ae3568af209428d0690"}
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.341263    6774 scope.go:122] "RemoveContainer" containerID="fb87a3b3fd484d26589a7722144ee7ce9a2ed747c81c0ae3568af209428d0690"
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:19.342036    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj_odh-ai-gateway-infra(59fa144b-e7fd-4bfc-aba8-3f3112adc882)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882"
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.344943    6774 generic.go:356] "Generic (PLEG): container finished" podID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerID="20b6cd1a3a681dd863570ca461e6d0c1311e5428d23f692f03abe759468ebee1" exitCode=60
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.345085    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerDied","Data":"20b6cd1a3a681dd863570ca461e6d0c1311e5428d23f692f03abe759468ebee1"}
Nov 03 21:45:19.347460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.346112    6774 scope.go:122] "RemoveContainer" containerID="20b6cd1a3a681dd863570ca461e6d0c1311e5428d23f692f03abe759468ebee1"
Nov 03 21:45:19.372444 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:19.346337    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x_odh-ai-gateway-infra(16b4a2a7-3e2c-44fa-8ae9-57537401e340)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340"
Nov 03 21:45:19.431516 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.431325    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"]
Nov 03 21:45:19.434536 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.433324    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Nov 03 21:45:19.434536 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.433376    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Nov 03 21:45:19.443495 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.443354    6774 scope.go:122] "RemoveContainer" containerID="d048ffa62cda49eed16ba37735d86ec03c7fd53eb4b878acb16014b82fa23052"
Nov 03 21:45:19.456407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.456370    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"]
Nov 03 21:45:19.467805 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.467537    6774 scope.go:122] "RemoveContainer" containerID="c6f144dd43ea1f5af49559f314af68ddfc23372fe6445f3fa7c23ffa1133ee59"
Nov 03 21:45:19.486707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.484862    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:19.486707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.486477    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:19.497750 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.489318    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:45:19.564265 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.564231    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"]
Nov 03 21:45:19.892348 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.892311    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Nov 03 21:45:19.892538 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:19.892379    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Nov 03 21:45:20.132143 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.132103    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:20.132552 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.132524    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:20.133692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.133665    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:45:20.446152 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.445990    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:20.447506 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.446709    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:20.450832 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.450768    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:45:20.559593 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.559263    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:20.651584 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.651541    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x\" (UniqueName: \"kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x\") pod \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") "
Nov 03 21:45:20.651768 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.651654    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca\") pod \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\" (UID: \"a3a5cd1d-6c78-477d-8ce7-a87f8b092505\") "
Nov 03 21:45:20.652591 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.652566    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca" pod "a3a5cd1d-6c78-477d-8ce7-a87f8b092505" (UID: "a3a5cd1d-6c78-477d-8ce7-a87f8b092505"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:20.653130 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.653110    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:20.653858 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.653832    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x" pod "a3a5cd1d-6c78-477d-8ce7-a87f8b092505" (UID: "a3a5cd1d-6c78-477d-8ce7-a87f8b092505"). InnerVolumeSpecName "kube-api-access-ms48x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:20.656695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.656677    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:20.753359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.753323    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca\") pod \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") "
Nov 03 21:45:20.753591 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.753459    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5\" (UniqueName: \"kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5\") pod \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\" (UID: \"16b4a2a7-3e2c-44fa-8ae9-57537401e340\") "
Nov 03 21:45:20.753727 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.753616    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm\" (UniqueName: \"kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm\") pod \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") "
Nov 03 21:45:20.753727 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.753673    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca\") pod \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\" (UID: \"59fa144b-e7fd-4bfc-aba8-3f3112adc882\") "
Nov 03 21:45:20.754144 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.754122    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms48x\" (UniqueName: \"kubernetes.io/projected/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-kube-api-access-ms48x\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:45:20.754230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.754148    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a5cd1d-6c78-477d-8ce7-a87f8b092505-maas-api-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:45:20.754295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.754258    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca" pod "16b4a2a7-3e2c-44fa-8ae9-57537401e340" (UID: "16b4a2a7-3e2c-44fa-8ae9-57537401e340"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:20.754481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.754456    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca" pod "59fa144b-e7fd-4bfc-aba8-3f3112adc882" (UID: "59fa144b-e7fd-4bfc-aba8-3f3112adc882"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:45:20.756478 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.756413    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm" pod "59fa144b-e7fd-4bfc-aba8-3f3112adc882" (UID: "59fa144b-e7fd-4bfc-aba8-3f3112adc882"). InnerVolumeSpecName "kube-api-access-kw8rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:20.756766 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.756741    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5" pod "16b4a2a7-3e2c-44fa-8ae9-57537401e340" (UID: "16b4a2a7-3e2c-44fa-8ae9-57537401e340"). InnerVolumeSpecName "kube-api-access-khmr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:45:20.855498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.855462    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16b4a2a7-3e2c-44fa-8ae9-57537401e340-maas-api-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:45:20.855498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.855498    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khmr5\" (UniqueName: \"kubernetes.io/projected/16b4a2a7-3e2c-44fa-8ae9-57537401e340-kube-api-access-khmr5\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:45:20.855736 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.855516    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw8rm\" (UniqueName: \"kubernetes.io/projected/59fa144b-e7fd-4bfc-aba8-3f3112adc882-kube-api-access-kw8rm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:45:20.855736 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.855531    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59fa144b-e7fd-4bfc-aba8-3f3112adc882-maas-api-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:45:20.895963 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.895875    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:20.896180 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.896159    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:20.896853 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:20.896835    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:45:21.367264 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.367229    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj" event={"ID":"59fa144b-e7fd-4bfc-aba8-3f3112adc882","Type":"ContainerDied","Data":"2c9c10be21d01b2bc444859f8811b7ac92c13e8f86c87dca4e6422f719413099"}
Nov 03 21:45:21.367501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.367238    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"
Nov 03 21:45:21.367501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.367294    6774 scope.go:122] "RemoveContainer" containerID="fb87a3b3fd484d26589a7722144ee7ce9a2ed747c81c0ae3568af209428d0690"
Nov 03 21:45:21.369285 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.369262    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"
Nov 03 21:45:21.369400 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.369304    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x" event={"ID":"16b4a2a7-3e2c-44fa-8ae9-57537401e340","Type":"ContainerDied","Data":"f5432847d3f29de8be3106d2fef106f4c837f8e76dfa10ff177509f3ed3fd9f8"}
Nov 03 21:45:21.371131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.371084    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"
Nov 03 21:45:21.371223 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.371115    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz" event={"ID":"a3a5cd1d-6c78-477d-8ce7-a87f8b092505","Type":"ContainerDied","Data":"d4975d266b7f873e6ef910acf7a55c826653a9a0a3976f536d5cb22c6cee791c"}
Nov 03 21:45:21.380001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.379978    6774 scope.go:122] "RemoveContainer" containerID="20b6cd1a3a681dd863570ca461e6d0c1311e5428d23f692f03abe759468ebee1"
Nov 03 21:45:21.389740 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.389720    6774 scope.go:122] "RemoveContainer" containerID="091e207a4ab3674fc584338d4ee13c78970303b8ab470c3f130b52059acf23fa"
Nov 03 21:45:21.422385 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.422351    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"]
Nov 03 21:45:21.429126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.429097    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-05bc27-29895705-9zzxj"]
Nov 03 21:45:21.514361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.514320    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"]
Nov 03 21:45:21.522456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.516270    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w6-517149-29895705-kmk5x"]
Nov 03 21:45:21.539289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.539260    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"]
Nov 03 21:45:21.544521 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:21.544496    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-dd5620-29895705-jx7xz"]
Nov 03 21:45:22.166091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:22.166057    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" path="/var/lib/kubelet/pods/16b4a2a7-3e2c-44fa-8ae9-57537401e340/volumes"
Nov 03 21:45:22.166787 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:22.166759    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" path="/var/lib/kubelet/pods/59fa144b-e7fd-4bfc-aba8-3f3112adc882/volumes"
Nov 03 21:45:22.167544 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:22.167520    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" path="/var/lib/kubelet/pods/a3a5cd1d-6c78-477d-8ce7-a87f8b092505/volumes"
Nov 03 21:45:25.424320 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424288    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"]
Nov 03 21:45:25.424840 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424792    6774 cpu_manager.go:414] "containerMap: removing container" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:25.424840 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424808    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:25.424840 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424819    6774 cpu_manager.go:414] "containerMap: removing container" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:25.424840 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424825    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:25.424840 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424834    6774 cpu_manager.go:414] "containerMap: removing container" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.424840 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424839    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424850    6774 cpu_manager.go:414] "containerMap: removing container" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424858    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424869    6774 cpu_manager.go:414] "containerMap: removing container" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424876    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424884    6774 cpu_manager.go:414] "containerMap: removing container" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424890    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424900    6774 cpu_manager.go:414] "containerMap: removing container" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.424904    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.425005    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.425012    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.425018    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.425024    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.425029    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:25.425163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.425037    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:25.429984 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.429953    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.459217 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.459189    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-0a6da1-openshift-default-dockercfg-dhxln\""
Nov 03 21:45:25.461982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.461957    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"]
Nov 03 21:45:25.512650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512614    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.512811 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512798    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkwqz\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.512864 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512826    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.512864 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512847    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.512957 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512943    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.512996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512966    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.512996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.512988    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.513073 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.513051    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.513143 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.513128    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614057    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614155    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614201    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614287    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkwqz\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614316    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614342    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614449    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614476    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614513    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614535    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614859    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.614967 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.614862    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.615015 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.615003    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.615103 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.615083    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.616847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.616821    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.617634 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.617610    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.634440 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.634403    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.634948 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.634926    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkwqz\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:25.743931 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:25.743841    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:26.084048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.084007    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"]
Nov 03 21:45:26.084197 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:26.084172    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130b25e9_a5f7_4ca1_a20f_e41e07700c2c.slice/crio-3b0a475bef8e67dd61f64741e97d0c6f20f5d9f4eab4b05602445042a1a2ed40 WatchSource:0}: Error finding container 3b0a475bef8e67dd61f64741e97d0c6f20f5d9f4eab4b05602445042a1a2ed40: Status 404 returned error can't find the container with id 3b0a475bef8e67dd61f64741e97d0c6f20f5d9f4eab4b05602445042a1a2ed40
Nov 03 21:45:26.086604 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.086574    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:26.086669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.086637    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:26.086669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.086665    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:26.408147 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.408104    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" event={"ID":"130b25e9-a5f7-4ca1-a20f-e41e07700c2c","Type":"ContainerStarted","Data":"5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c"}
Nov 03 21:45:26.408333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.408170    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" event={"ID":"130b25e9-a5f7-4ca1-a20f-e41e07700c2c","Type":"ContainerStarted","Data":"3b0a475bef8e67dd61f64741e97d0c6f20f5d9f4eab4b05602445042a1a2ed40"}
Nov 03 21:45:26.452780 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.452727    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podStartSLOduration=1.452712807 podStartE2EDuration="1.452712807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:26.451620865 +0000 UTC m=+896.418457601" watchObservedRunningTime="2026-11-03 21:45:26.452712807 +0000 UTC m=+896.419549540"
Nov 03 21:45:26.744124 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:26.744044    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:27.761657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:27.761604    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:27.762097 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:27.761714    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:28.745447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:28.744724    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:28.745447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:28.744792    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:29.745442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:29.744744    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:29.745442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:29.744817    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:30.761481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:30.751809    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:30.761481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:30.751873    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:31.399155 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:45:31.399113    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:45:31.749499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:31.748834    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:31.749499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:31.748906    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:32.745446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:32.744851    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:32.745446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:32.744922    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:33.746455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:33.746208    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Nov 03 21:45:33.746455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:33.746281    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Nov 03 21:45:34.749212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:34.749176    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:34.749697 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:34.749468    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:34.750469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:34.750447    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:45:49.852347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.852316    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"]
Nov 03 21:45:49.853113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853092    6774 cpu_manager.go:414] "containerMap: removing container" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:49.853210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853114    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:49.853210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853138    6774 cpu_manager.go:414] "containerMap: removing container" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:49.853210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853147    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:49.853361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853282    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="16b4a2a7-3e2c-44fa-8ae9-57537401e340" containerName="cleanup"
Nov 03 21:45:49.853361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853303    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="59fa144b-e7fd-4bfc-aba8-3f3112adc882" containerName="cleanup"
Nov 03 21:45:49.853361 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.853321    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3a5cd1d-6c78-477d-8ce7-a87f8b092505" containerName="cleanup"
Nov 03 21:45:49.856966 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.856942    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.881284 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.881255    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"]
Nov 03 21:45:49.983632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983586    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983808 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983693    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983855 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983828    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983862    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983929 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983889    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqczf\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983960 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983951    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983975    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.983997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.983990    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:49.984062 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:49.984016    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085158 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085120    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085167    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085276    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085343    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085391    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqczf\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085462    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085498    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085529    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085806 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085576    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.085806 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.085733    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.086046 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.086018    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.086330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.086280    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.086467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.086401    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.086467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.086402    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.088124 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.088100    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.088323 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.088294    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.103700 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.103630    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.103823 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.103749    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqczf\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.170646 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.170611    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:50.481846 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.481718    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"]
Nov 03 21:45:50.484438 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:50.484396    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc2cda4_4240_400b_bd7b_d444909c9bce.slice/crio-8792ea9c2f1405b961892e4e33c3485848e23ad0bebcfb1f988b8e5248232da4 WatchSource:0}: Error finding container 8792ea9c2f1405b961892e4e33c3485848e23ad0bebcfb1f988b8e5248232da4: Status 404 returned error can't find the container with id 8792ea9c2f1405b961892e4e33c3485848e23ad0bebcfb1f988b8e5248232da4
Nov 03 21:45:50.487241 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.487206    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:50.487343 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.487273    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:50.487343 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.487302    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:50.635883 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.635829    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" event={"ID":"8dc2cda4-4240-400b-bd7b-d444909c9bce","Type":"ContainerStarted","Data":"022cba4b3666321d2994a61ba446b895cd777bc97d878eb40a1e57f5ec44837e"}
Nov 03 21:45:50.636076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.635898    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" event={"ID":"8dc2cda4-4240-400b-bd7b-d444909c9bce","Type":"ContainerStarted","Data":"8792ea9c2f1405b961892e4e33c3485848e23ad0bebcfb1f988b8e5248232da4"}
Nov 03 21:45:50.674394 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:50.674311    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podStartSLOduration=1.674292262 podStartE2EDuration="1.674292262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:50.673397097 +0000 UTC m=+920.640233871" watchObservedRunningTime="2026-11-03 21:45:50.674292262 +0000 UTC m=+920.641128999"
Nov 03 21:45:51.171713 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:51.171678    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:51.173331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:51.173306    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:51.173470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:51.173355    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:52.172563 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:52.172527    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:52.173183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:52.173146    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:53.172778 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:53.172739    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:53.175164 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:53.175115    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:54.171251 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:54.171218    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:54.171436 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:54.171281    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:55.065748 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.065714    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"]
Nov 03 21:45:55.070185 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.070152    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.097254 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.097220    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"]
Nov 03 21:45:55.171507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.171470    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:55.171680 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.171532    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:55.176794 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.176763    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.176917 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.176799    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.176917 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.176826    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.176992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.176947    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdzq9\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.177033 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.177000    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.177119 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.177107    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.177154 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.177137    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.177201 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.177162    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.177326 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.177309    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.219729 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.219691    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"]
Nov 03 21:45:55.223692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.223670    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.278019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.277989    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"]
Nov 03 21:45:55.278542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278508    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278574    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdzq9\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278625    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278675    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278703    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278736    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278945 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278814    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278945 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278877    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.278945 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.278900    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.279104 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.279071    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.279162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.279132    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.279379 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.279336    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.279525 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.279448    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.279525 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.279395    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.280979 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.280958    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.281969 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.281943    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.298023 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.297992    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.298651 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.298589    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdzq9\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9\") pod \"e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") " pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.380570 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380542    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.380746 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380658    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.380746 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380695    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.380746 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380733    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkdhz\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.380884 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380865    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.380919 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380903    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.380973 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380962    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.381012 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.380996    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.381048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.381023    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.386198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.386180    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482536    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482598    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482656    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkdhz\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482759    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482795    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482827    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482856    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482887    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.483275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.482924    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.484182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.484157    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.492916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.484968    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.492916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.485191    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.492916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.486165    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.492916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.486648    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.492916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.487184    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.493902 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.493851    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.503113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.503090    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkdhz\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.505703 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.505683    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.570937 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.570902    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:55.726230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.726144    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"]
Nov 03 21:45:55.730238 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:55.730203    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adaa258_956e_426e_8912_fae770dfc3d8.slice/crio-1032b0aad0be10de31a6d8e59a6aedc92288bb60e20d1a2bfb553230ecf81707 WatchSource:0}: Error finding container 1032b0aad0be10de31a6d8e59a6aedc92288bb60e20d1a2bfb553230ecf81707: Status 404 returned error can't find the container with id 1032b0aad0be10de31a6d8e59a6aedc92288bb60e20d1a2bfb553230ecf81707
Nov 03 21:45:55.733020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.732982    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:55.733134 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.733067    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:55.733134 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.733111    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:55.888254 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.888220    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"]
Nov 03 21:45:55.888718 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:45:55.888686    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc317210d_c74a_4470_8ba9_e9467d55e78a.slice/crio-1539ff2e8552e425fa426b80df770f3f0929cb64a5a736e92c7dc5dc5e2791c5 WatchSource:0}: Error finding container 1539ff2e8552e425fa426b80df770f3f0929cb64a5a736e92c7dc5dc5e2791c5: Status 404 returned error can't find the container with id 1539ff2e8552e425fa426b80df770f3f0929cb64a5a736e92c7dc5dc5e2791c5
Nov 03 21:45:55.891547 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.891513    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:55.891657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.891582    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:55.891657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:55.891617    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:45:56.174322 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.174283    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:56.174843 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.174344    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:56.717337 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.716670    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" event={"ID":"c317210d-c74a-4470-8ba9-e9467d55e78a","Type":"ContainerStarted","Data":"cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa"}
Nov 03 21:45:56.717337 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.716741    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" event={"ID":"c317210d-c74a-4470-8ba9-e9467d55e78a","Type":"ContainerStarted","Data":"1539ff2e8552e425fa426b80df770f3f0929cb64a5a736e92c7dc5dc5e2791c5"}
Nov 03 21:45:56.719255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.719216    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" event={"ID":"9adaa258-956e-426e-8912-fae770dfc3d8","Type":"ContainerStarted","Data":"256c4ce508b9686fc98ad3fd047e8783e67b16c388c3702523d4b6d276414477"}
Nov 03 21:45:56.719391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.719281    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" event={"ID":"9adaa258-956e-426e-8912-fae770dfc3d8","Type":"ContainerStarted","Data":"1032b0aad0be10de31a6d8e59a6aedc92288bb60e20d1a2bfb553230ecf81707"}
Nov 03 21:45:56.840446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.835079    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podStartSLOduration=1.835056901 podStartE2EDuration="1.835056901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:56.783556114 +0000 UTC m=+926.750392850" watchObservedRunningTime="2026-11-03 21:45:56.835056901 +0000 UTC m=+926.801893636"
Nov 03 21:45:56.851445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:56.847555    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podStartSLOduration=1.847533842 podStartE2EDuration="1.847533842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:45:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:45:56.846593544 +0000 UTC m=+926.813430277" watchObservedRunningTime="2026-11-03 21:45:56.847533842 +0000 UTC m=+926.814370577"
Nov 03 21:45:57.176463 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.171966    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Nov 03 21:45:57.176463 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.172047    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Nov 03 21:45:57.395445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.395120    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:45:57.395445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.395287    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 03 21:45:57.395445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.395348    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 03 21:45:57.573220 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.573129    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:45:57.573624 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.573598    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 03 21:45:57.573824 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:57.573775    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 03 21:45:58.192881 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.192848    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:58.193366 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.193140    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:58.194212 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.194192    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:45:58.387445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.386920    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 03 21:45:58.387445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.386981    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 03 21:45:58.575501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.574846    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 03 21:45:58.575501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:58.574908    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 03 21:45:59.388697 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:59.388654    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 03 21:45:59.389232 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:59.388721    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 03 21:45:59.574449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:59.573912    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 03 21:45:59.574449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:45:59.573990    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 03 21:46:00.400447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.399850    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 03 21:46:00.400447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.399928    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 03 21:46:00.402748 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.402704    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"]
Nov 03 21:46:00.408295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.408273    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"]
Nov 03 21:46:00.408459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.408393    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.440689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.440656    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-517149\"/\"distinct-2-w6-517149-kserve-self-signed-certs\""
Nov 03 21:46:00.441001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.440980    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-517149\"/\"default-dockercfg-jbw89\""
Nov 03 21:46:00.441230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.441213    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-517149\"/\"kube-root-ca.crt\""
Nov 03 21:46:00.441449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.441414    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-517149\"/\"openshift-service-ca.crt\""
Nov 03 21:46:00.501237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.501197    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.501544 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.501515    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl8f7\" (UniqueName: \"kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.501771 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.501752    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.501948 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.501931    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.502103 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.502088    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.502239 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.502223    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.572867 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.572827    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 03 21:46:00.573205 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.573164    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 03 21:46:00.604303 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.604265    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.604712 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.604685    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl8f7\" (UniqueName: \"kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.604915 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.604899    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.605093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.605078    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.606742 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.606719    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.607307 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.607288    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.608010 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.607217    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.608152 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.605626    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.608272 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.607705    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.661925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.661801    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl8f7\" (UniqueName: \"kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.667443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.663583    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.678891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.678321    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm\") pod \"distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") " pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:00.727833 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:00.727791    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:01.293140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.293108    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"]
Nov 03 21:46:01.388477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.387977    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 03 21:46:01.388477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.388038    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 03 21:46:01.419908 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:46:01.419875    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:46:01.575507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.574953    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 03 21:46:01.575507 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.575018    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 03 21:46:01.873068 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.871995    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" event={"ID":"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d","Type":"ContainerStarted","Data":"dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233"}
Nov 03 21:46:01.873068 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.872050    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" event={"ID":"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d","Type":"ContainerStarted","Data":"bfdea7ea0c60f59c44ed1f9bc9323c89bbaaf512214f50c3f451828a4685a413"}
Nov 03 21:46:01.917435 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:01.917364    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podStartSLOduration=1.9173509260000001 podStartE2EDuration="1.917350926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:46:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:46:01.914575427 +0000 UTC m=+931.881412173" watchObservedRunningTime="2026-11-03 21:46:01.917350926 +0000 UTC m=+931.884187659"
Nov 03 21:46:02.387564 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:02.387504    6774 patch_prober.go:29] interesting pod/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Nov 03 21:46:02.387774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:02.387614    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Nov 03 21:46:02.572242 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:02.572199    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Nov 03 21:46:02.572663 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:02.572271    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Nov 03 21:46:02.738099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:02.738024    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:03.479444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.479391    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:46:03.480411 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.480386    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:46:03.482477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.482452    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:46:03.576455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.576381    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:46:03.576921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.576720    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:46:03.577542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.577519    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:46:03.617879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.617845    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"]
Nov 03 21:46:03.622384 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.622337    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.643107 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.643077    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"]
Nov 03 21:46:03.644149 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.644119    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-0a6da1\"/\"distinct-2-w5-0a6da1-kserve-self-signed-certs\""
Nov 03 21:46:03.827952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.827853    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.828355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.828332    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.828557 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.828537    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.828832 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.828816    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.828982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.828967    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xq9p\" (UniqueName: \"kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.829125 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.829111    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.931196 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.931155    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.931404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.931219    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xq9p\" (UniqueName: \"kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.931656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.931629    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.931887 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.931863    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.931987 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.931889    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.931987 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.931983    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.932109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.932057    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.932170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.932142    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.932601 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.932578    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.933807 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.933778    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.934888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.934866    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:03.950694 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:03.950669    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xq9p\" (UniqueName: \"kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p\") pod \"distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") " pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:04.246682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:04.246652    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:04.546436 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:04.546393    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"]
Nov 03 21:46:04.549371 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:46:04.549336    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ab9e918_e21e_4a49_9015_66ecfed84b9c.slice/crio-0d2cd350543a586714729bcfd69dcd006b82dece873cc4fd7d158f4accec4091 WatchSource:0}: Error finding container 0d2cd350543a586714729bcfd69dcd006b82dece873cc4fd7d158f4accec4091: Status 404 returned error can't find the container with id 0d2cd350543a586714729bcfd69dcd006b82dece873cc4fd7d158f4accec4091
Nov 03 21:46:04.893395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:04.893349    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" event={"ID":"7ab9e918-e21e-4a49-9015-66ecfed84b9c","Type":"ContainerStarted","Data":"5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e"}
Nov 03 21:46:04.893395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:04.893399    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" event={"ID":"7ab9e918-e21e-4a49-9015-66ecfed84b9c","Type":"ContainerStarted","Data":"0d2cd350543a586714729bcfd69dcd006b82dece873cc4fd7d158f4accec4091"}
Nov 03 21:46:04.932019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:04.931962    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podStartSLOduration=1.931944826 podStartE2EDuration="1.931944826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:46:04.929381713 +0000 UTC m=+934.896218447" watchObservedRunningTime="2026-11-03 21:46:04.931944826 +0000 UTC m=+934.898781557"
Nov 03 21:46:05.247394 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:05.247304    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:10.737477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:10.737444    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:10.750694 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:10.750666    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:10.942500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:10.942470    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:14.247294 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:14.247261    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:14.259852 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:14.259827    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:14.965996 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:14.965964    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:17.175447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:17.171584    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 21:46:17.358478 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:17.357531    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:17.432501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:17.431534    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:17.503446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:17.494519    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:17.770299 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:17.769589    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:17.785461 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:17.785336    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:31.398116 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:46:31.398074    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:46:34.988975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:34.988935    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"]
Nov 03 21:46:34.995235 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:34.995208    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.018116 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.018084    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"]
Nov 03 21:46:35.072091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072059    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072108    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072179    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072329 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072283    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072369 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072350    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072530 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072486    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbfvf\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072668 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072538    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072724 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072664    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.072724 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.072693    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.173813 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.173780    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.173813 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.173824    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.173843    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.173879    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.173930    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.173982    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbfvf\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174082 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.174007    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174343 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.174101    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174343 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.174148    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174679 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.174651    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.174959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.174940    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.175109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.175088    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.175174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.175104    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.175174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.175145    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.177143 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.177113    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.177143 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.177128    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.191999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.191970    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbfvf\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.192384 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.192360    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token\") pod \"e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") " pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.311024 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.310945    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:35.624559 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.624526    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"]
Nov 03 21:46:35.628257 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:46:35.628230    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c1cf21_5efd_423c_969f_623ba164d70e.slice/crio-c615431b82edc0eb9f1fb703d92e2f3185aae867dbe615d3732feceed21d6a44 WatchSource:0}: Error finding container c615431b82edc0eb9f1fb703d92e2f3185aae867dbe615d3732feceed21d6a44: Status 404 returned error can't find the container with id c615431b82edc0eb9f1fb703d92e2f3185aae867dbe615d3732feceed21d6a44
Nov 03 21:46:35.630786 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.630723    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:35.630866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.630836    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:35.630932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:35.630877    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:36.159626 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:36.159594    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" event={"ID":"c6c1cf21-5efd-423c-969f-623ba164d70e","Type":"ContainerStarted","Data":"2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56"}
Nov 03 21:46:36.159997 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:36.159644    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" event={"ID":"c6c1cf21-5efd-423c-969f-623ba164d70e","Type":"ContainerStarted","Data":"c615431b82edc0eb9f1fb703d92e2f3185aae867dbe615d3732feceed21d6a44"}
Nov 03 21:46:36.204476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:36.204403    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podStartSLOduration=2.204385664 podStartE2EDuration="2.204385664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:46:36.190340696 +0000 UTC m=+966.157177431" watchObservedRunningTime="2026-11-03 21:46:36.204385664 +0000 UTC m=+966.171222397"
Nov 03 21:46:36.311351 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:36.311314    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:36.312495 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:36.312461    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:36.312622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:36.312519    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:37.311906 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:37.311867    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:37.312324 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:37.311938    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:38.311982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:38.311949    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:38.312365 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:38.312012    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:39.312191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:39.312153    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:39.312590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:39.312211    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:40.063989 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.063949    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"]
Nov 03 21:46:40.069183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.069154    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.086157 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.083077    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"]
Nov 03 21:46:40.172180 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172144    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172209    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172306    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172356    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172466    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172515    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncfh7\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172616 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172538    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172675 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172655    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.172767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.172748    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273620 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273588    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273643    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncfh7\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273669    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273694    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273746    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273848    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.273944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273889    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.273964    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.274024    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.274196    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274306 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.274248    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274365 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.274333    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.274397    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.274564 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.274542    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.276347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.276324    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.276732 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.276710    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.291646 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.291621    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.291816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.291795    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncfh7\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7\") pod \"e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") " pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.311841 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.311811    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:40.311963 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.311869    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:40.358447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.355814    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"]
Nov 03 21:46:40.390239 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.390204    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"]
Nov 03 21:46:40.390412 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.390329    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.394368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.394341    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.491699    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.491757    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.491785    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.491949    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.491985    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.492012    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.492155    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.492208    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r2w9\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.493359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.492240    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593435 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593394    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593638 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593486    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593638 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593506    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593638 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593521    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593638 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593625    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593797 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593649    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593797 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593672    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593797 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593788    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.593905 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593831    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r2w9\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.594018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.593994    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.594142 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.594117    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.594199 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.594160    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.594278 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.594257    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.594376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.594349    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.596230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.596210    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.596356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.596340    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.610811 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.610746    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.610926 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.610907    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r2w9\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9\") pod \"e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") " pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.708349 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.708323    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:40.732491 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.732466    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"]
Nov 03 21:46:40.735823 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:46:40.735796    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4513bd0_8f2e_4b39_8803_42fd08e8a3be.slice/crio-495f27b450345359358a8df4ec86713e9cdf1c87268df226330c9f8435b4d783 WatchSource:0}: Error finding container 495f27b450345359358a8df4ec86713e9cdf1c87268df226330c9f8435b4d783: Status 404 returned error can't find the container with id 495f27b450345359358a8df4ec86713e9cdf1c87268df226330c9f8435b4d783
Nov 03 21:46:40.764014 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.763969    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:40.764288 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.764263    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:40.764440 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:40.764405    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:41.067355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.067316    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"]
Nov 03 21:46:41.071601 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:46:41.071575    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f7d167_1319_4d54_9ad6_bf92e1a615d4.slice/crio-3cc10b57024285f9d0191cd23984ee1587685a4df605983bf15c06c05ad5691f WatchSource:0}: Error finding container 3cc10b57024285f9d0191cd23984ee1587685a4df605983bf15c06c05ad5691f: Status 404 returned error can't find the container with id 3cc10b57024285f9d0191cd23984ee1587685a4df605983bf15c06c05ad5691f
Nov 03 21:46:41.074999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.074960    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:41.075106 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.075025    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:41.075106 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.075055    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:46:41.201297 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.201233    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" event={"ID":"c5f7d167-1319-4d54-9ad6-bf92e1a615d4","Type":"ContainerStarted","Data":"d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885"}
Nov 03 21:46:41.201483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.201346    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" event={"ID":"c5f7d167-1319-4d54-9ad6-bf92e1a615d4","Type":"ContainerStarted","Data":"3cc10b57024285f9d0191cd23984ee1587685a4df605983bf15c06c05ad5691f"}
Nov 03 21:46:41.205472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.205312    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" event={"ID":"f4513bd0-8f2e-4b39-8803-42fd08e8a3be","Type":"ContainerStarted","Data":"9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7"}
Nov 03 21:46:41.205472 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.205377    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" event={"ID":"f4513bd0-8f2e-4b39-8803-42fd08e8a3be","Type":"ContainerStarted","Data":"495f27b450345359358a8df4ec86713e9cdf1c87268df226330c9f8435b4d783"}
Nov 03 21:46:41.251454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.248811    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podStartSLOduration=1.248791764 podStartE2EDuration="1.248791764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:46:41.242727859 +0000 UTC m=+971.209564594" watchObservedRunningTime="2026-11-03 21:46:41.248791764 +0000 UTC m=+971.215628499"
Nov 03 21:46:41.289334 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.289266    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podStartSLOduration=1.289246779 podStartE2EDuration="1.289246779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:46:41.284766438 +0000 UTC m=+971.251603185" watchObservedRunningTime="2026-11-03 21:46:41.289246779 +0000 UTC m=+971.256083514"
Nov 03 21:46:41.312241 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.312207    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:41.312387 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.312255    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:41.395966 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.395870    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:41.397493 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.397464    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:41.397731 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.397698    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:41.710621 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:41.710526    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:42.312443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:42.311933    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:42.312443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:42.311998    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:42.402444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:42.395945    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:42.402444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:42.396011    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:42.714447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:42.713715    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:42.714447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:42.713798    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:43.160446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.159841    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.165444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.161198    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.193447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.192514    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.315448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.314758    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Nov 03 21:46:43.315448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.314833    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Nov 03 21:46:43.354466 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.351540    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.396447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.395941    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:43.396447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.396007    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:43.440610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.440506    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.489595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.489528    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.763502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.756993    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.820798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.820752    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.867447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.861348    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:43.867447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.861408    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:43.867447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.863140    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.952446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.947262    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:43.980467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:43.967007    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": context deadline exceeded"
Nov 03 21:46:44.275609 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.275543    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 21:46:44.303449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.277344    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:46:44.387481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.304501    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:44.388047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.355935    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:44.442476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.442402    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:44.509174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.461671    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:44.509757 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.509489    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:44.510567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.509578    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:44.710344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.709840    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:44.710344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.709919    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:44.812698 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.812497    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Nov 03 21:46:44.821610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.821569    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 21:46:44.889442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.887185    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:44.959479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.948673    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:44.960944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.960863    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:46:44.961318 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.961303    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:46:44.961537 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.961523    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:46:44.961756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.961742    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:46:44.976468 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.962061    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:46:44.976859 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.976840    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:46:44.977073 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.977061    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:46:44.977362 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.977348    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:46:44.977587 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:44.977574    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:45.010636 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.010591    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:45.514622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.514576    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 03 21:46:45.515620 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.515588    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": context deadline exceeded"
Nov 03 21:46:45.516072 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.516049    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": context deadline exceeded"
Nov 03 21:46:45.723009 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.523530    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:45.830495 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.821545    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:45.877452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.845500    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:45.917701 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.917667    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:45.917984 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.917935    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:45.965862 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.958768    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:46:45.995203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.994583    6774 patch_prober.go:29] interesting pod/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 21:46:45.995203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.994640    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:45.996562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.996523    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:45.996757 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:45.996732    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:46.054500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.025568    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Nov 03 21:46:46.054500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.025599    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:46.054500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.042838    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:46:46.349833 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.349802    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:46:46.350154 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.350139    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:46.350324 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.350310    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:46:46.351721 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.351703    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:46:46.351921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.351907    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:46:46.399718 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.391609    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:46.399718 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.391733    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:46:46.410830 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.410791    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:46.411090 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.411058    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:46.430453 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.428062    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:46:46.432281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.432260    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:46:46.433733 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.433712    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:46:46.496443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.496392    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:46:46.708995 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.708908    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:46.708995 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:46.708968    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:47.395131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:47.395089    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:47.395347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:47.395160    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:47.709555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:47.709460    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:47.709555 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:47.709536    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:48.394938 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:48.394896    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:48.395121 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:48.394956    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:48.709060 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:48.708969    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:48.709060 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:48.709028    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:49.395151 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:49.395120    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Nov 03 21:46:49.395535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:49.395175    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Nov 03 21:46:49.708893 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:49.708854    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Nov 03 21:46:49.709181 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:49.708922    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Nov 03 21:46:50.698380 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:50.698344    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:50.716238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:50.712517    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:50.721214 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:50.721179    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:46:51.194575 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:51.194526    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:51.195347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:51.195324    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:51.196497 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:51.196476    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:46:58.180032 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.179999    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"]
Nov 03 21:46:58.185191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.185149    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.201054 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.201025    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"]
Nov 03 21:46:58.209460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.209385    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 21:46:58.209787 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.209561    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:46:58.254602 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.254563    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.254756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.254691    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gx5d\" (UniqueName: \"kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.254756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.254752    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.356149 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.356117    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.356304 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.356194    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gx5d\" (UniqueName: \"kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.356304 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.356262    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.356978 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.356951    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.358649 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.358623    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.374102 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.374073    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gx5d\" (UniqueName: \"kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d\") pod \"maas-api-revoke-sub-2b02f255-xhjvh\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.501697 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.501616    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:46:58.802184 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:58.802155    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"]
Nov 03 21:46:58.805412 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:46:58.805370    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8b719a_8603_4626_b6a1_b026d00297e0.slice/crio-30ff306cd1b955ae868dc34ceefec54782f9f78774c285df2bf10c2a7c72017b WatchSource:0}: Error finding container 30ff306cd1b955ae868dc34ceefec54782f9f78774c285df2bf10c2a7c72017b: Status 404 returned error can't find the container with id 30ff306cd1b955ae868dc34ceefec54782f9f78774c285df2bf10c2a7c72017b
Nov 03 21:46:59.776243 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:59.776209    6774 generic.go:356] "Generic (PLEG): container finished" podID="bc8b719a-8603-4626-b6a1-b026d00297e0" containerID="c1fdeaf6852bd65362b2e49f400236721b17c2c7fc3f8f6bc47438a4fbf34a04" exitCode=0
Nov 03 21:46:59.776670 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:59.776279    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh" event={"ID":"bc8b719a-8603-4626-b6a1-b026d00297e0","Type":"ContainerDied","Data":"c1fdeaf6852bd65362b2e49f400236721b17c2c7fc3f8f6bc47438a4fbf34a04"}
Nov 03 21:46:59.776670 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:46:59.776319    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh" event={"ID":"bc8b719a-8603-4626-b6a1-b026d00297e0","Type":"ContainerStarted","Data":"30ff306cd1b955ae868dc34ceefec54782f9f78774c285df2bf10c2a7c72017b"}
Nov 03 21:47:00.943906 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:00.943878    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:47:00.993430 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:00.993396    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca\") pod \"bc8b719a-8603-4626-b6a1-b026d00297e0\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") "
Nov 03 21:47:00.993669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:00.993490    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca\") pod \"bc8b719a-8603-4626-b6a1-b026d00297e0\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") "
Nov 03 21:47:00.993669 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:00.993587    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d\" (UniqueName: \"kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d\") pod \"bc8b719a-8603-4626-b6a1-b026d00297e0\" (UID: \"bc8b719a-8603-4626-b6a1-b026d00297e0\") "
Nov 03 21:47:00.995004 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:00.994964    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca" pod "bc8b719a-8603-4626-b6a1-b026d00297e0" (UID: "bc8b719a-8603-4626-b6a1-b026d00297e0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:47:00.996693 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:00.996400    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d" pod "bc8b719a-8603-4626-b6a1-b026d00297e0" (UID: "bc8b719a-8603-4626-b6a1-b026d00297e0"). InnerVolumeSpecName "kube-api-access-7gx5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:01.002767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.002743    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca" pod "bc8b719a-8603-4626-b6a1-b026d00297e0" (UID: "bc8b719a-8603-4626-b6a1-b026d00297e0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:01.096077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.096044    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gx5d\" (UniqueName: \"kubernetes.io/projected/bc8b719a-8603-4626-b6a1-b026d00297e0-kube-api-access-7gx5d\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:01.096077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.096075    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:01.096282 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.096089    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bc8b719a-8603-4626-b6a1-b026d00297e0-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:01.430821 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:47:01.430102    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:47:01.806788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.797990    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"
Nov 03 21:47:01.806788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.797995    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh" event={"ID":"bc8b719a-8603-4626-b6a1-b026d00297e0","Type":"ContainerDied","Data":"30ff306cd1b955ae868dc34ceefec54782f9f78774c285df2bf10c2a7c72017b"}
Nov 03 21:47:01.806788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:01.798091    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30ff306cd1b955ae868dc34ceefec54782f9f78774c285df2bf10c2a7c72017b"
Nov 03 21:47:10.872877 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.872800    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"]
Nov 03 21:47:10.873640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.873410    6774 cpu_manager.go:414] "containerMap: removing container" podUID="bc8b719a-8603-4626-b6a1-b026d00297e0" containerName="revoke-keys"
Nov 03 21:47:10.873640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.873456    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc8b719a-8603-4626-b6a1-b026d00297e0" containerName="revoke-keys"
Nov 03 21:47:10.873640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.873627    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc8b719a-8603-4626-b6a1-b026d00297e0" containerName="revoke-keys"
Nov 03 21:47:10.878512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.878493    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.910134 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.910098    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"]
Nov 03 21:47:10.976111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976074    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976110    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976316 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976216    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnnx8\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976343    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976387 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976363    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976400    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976515 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976502    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976543    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:10.976584 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:10.976571    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078011    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnnx8\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078115    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078135    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078169    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078198    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078234    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078280    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078389    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078413    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078752 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078616    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078752 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078681    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078752 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078727    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.078955 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.078797    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.079110 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.079091    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.080659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.080640    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.080783 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.080766    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.096309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.096287    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.096451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.096305    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnnx8\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8\") pod \"e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") " pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.192752 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.192673    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:11.508707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.508682    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"]
Nov 03 21:47:11.510691 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:47:11.510661    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e791e1_8d92_4bfe_9865_8a67e8268b49.slice/crio-9ef24fe94196a6aeb375aa88d3ac8ce08eb448871c05f333e5c69433d6f9d4f3 WatchSource:0}: Error finding container 9ef24fe94196a6aeb375aa88d3ac8ce08eb448871c05f333e5c69433d6f9d4f3: Status 404 returned error can't find the container with id 9ef24fe94196a6aeb375aa88d3ac8ce08eb448871c05f333e5c69433d6f9d4f3
Nov 03 21:47:11.513204 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.513171    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:11.513279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.513236    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:11.513279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.513271    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:11.880434 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.880380    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" event={"ID":"80e791e1-8d92-4bfe-9865-8a67e8268b49","Type":"ContainerStarted","Data":"a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d"}
Nov 03 21:47:11.880815 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.880507    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" event={"ID":"80e791e1-8d92-4bfe-9865-8a67e8268b49","Type":"ContainerStarted","Data":"9ef24fe94196a6aeb375aa88d3ac8ce08eb448871c05f333e5c69433d6f9d4f3"}
Nov 03 21:47:11.920346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:11.920282    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podStartSLOduration=1.9202634349999999 podStartE2EDuration="1.920263435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:47:11.918889757 +0000 UTC m=+1001.885726502" watchObservedRunningTime="2026-11-03 21:47:11.920263435 +0000 UTC m=+1001.887100168"
Nov 03 21:47:12.193788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:12.193707    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:12.195323 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:12.195294    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:12.195481 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:12.195345    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:13.193475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:13.193410    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:13.193943 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:13.193516    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:14.193774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:14.193741    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:14.194180 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:14.193792    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:15.193102 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:15.193060    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:15.193320 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:15.193136    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:16.193390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:16.193349    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:16.193848 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:16.193406    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:17.193397 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:17.193354    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:17.193877 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:17.193453    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:18.193628 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:18.193588    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Nov 03 21:47:18.194043 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:18.193659    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Nov 03 21:47:19.197691 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:19.197660    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:19.198083 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:19.198054    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:19.198673 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:19.198654    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:47:22.247040 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:22.247000    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"]
Nov 03 21:47:23.191446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.190656    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:23.291447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.282518    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:23.437779 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.436963    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded"
Nov 03 21:47:23.495788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.495564    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:23.517463 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.516705    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:23.517676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.517584    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:23.554563 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:23.554517    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:24.066453 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.032315    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:24.091373 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.035706    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": context deadline exceeded"
Nov 03 21:47:24.555448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.552142    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 03 21:47:24.558606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.558559    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:24.561565 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.561513    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:24.658446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.581863    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:24.744456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.740587    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": context deadline exceeded"
Nov 03 21:47:24.746542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.746493    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Nov 03 21:47:24.870445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.870160    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:47:24.870445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.870232    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:47:24.870445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.870271    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:47:24.870445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.870304    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:47:24.948695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:24.948648    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:47:25.012965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.012931    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:47:25.146504 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.146176    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.167444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.166664    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.167444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.167025    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:47:25.171452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.167794    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:47:25.312448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.297855    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": context deadline exceeded"
Nov 03 21:47:25.342757 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.342712    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.487505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.486618    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.573445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.572583    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.596582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.583959    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.742565 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.742466    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.743550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.743525    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:47:25.797451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.786206    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:25.825151 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.825120    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:47:25.959449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:25.952547    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.134509 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.089574    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.180710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.180663    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": context deadline exceeded"
Nov 03 21:47:26.218234 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.217376    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.333035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.332976    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.548032 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.547935    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.589646 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.589599    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.594453 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.591336    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Nov 03 21:47:26.613447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.601884    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"]
Nov 03 21:47:26.636946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.636914    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:47:26.639099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.637759    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.639283 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.639084    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.746243    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778388    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778450    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shgrl\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778490    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778541    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778566    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778838    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778890    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778949    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.780446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.778976    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:26.861372 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.861329    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": context deadline exceeded"
Nov 03 21:47:26.988452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.957737    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:26.988452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:26.958104    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:47:27.047863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.047742    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:47:27.051588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.051379    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"]
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.073880    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.074024    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.074084    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.074212    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shgrl\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.074349    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.074506    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.108376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.074540    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.106338    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.082600    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.109473    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.109775    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.143803    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.143868    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.144797    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.111472    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.169505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.159641    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:47:27.182898 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.182858    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:27.214454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.195417    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.214454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.204333    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.216177 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.215370    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shgrl\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.224791 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.224760    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:27.246449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.245293    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.265806 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.264958    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:47:27.272693 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.266588    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:47:27.279365 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.279341    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:47:27.407446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.365546    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:47:27.448550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.447988    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:47:27.482777 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.482695    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:27.491528 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.491500    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:47:27.538191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.512554    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"]
Nov 03 21:47:27.758139 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.758052    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"]
Nov 03 21:47:27.758772 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.758143    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:47:27.758772 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.758282    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.786061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.785740    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xwclq\""
Nov 03 21:47:27.786061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.785818    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Nov 03 21:47:27.786061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.785866    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Nov 03 21:47:27.786061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.785909    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Nov 03 21:47:27.809928 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.806888    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:47:27.826715 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.826685    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:47:27.906939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.906904    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrsrp\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.907122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.907097    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.907206 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.907155    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.907295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.907280    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.907395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.907381    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.907712 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.907685    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:27.908751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:27.908001    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009480    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009700 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009580    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009700 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009684    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009787 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009746    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009857 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009842    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009915 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009876    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.009971 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.009958    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrsrp\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.010277 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.010241    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.012081 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.012052    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.012196 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.012167    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.012383 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.012360    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.012575 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.012556    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.035937 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.035909    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrsrp\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.036315 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.036295    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-k2sqn\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.056580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.056547    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"]
Nov 03 21:47:28.057940 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:47:28.057912    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcff539_ca9a_41bb_9be6_e8a658863884.slice/crio-270a3ac765667d4fe9df531284369503fab95703a1553c010ef0a362aa885500 WatchSource:0}: Error finding container 270a3ac765667d4fe9df531284369503fab95703a1553c010ef0a362aa885500: Status 404 returned error can't find the container with id 270a3ac765667d4fe9df531284369503fab95703a1553c010ef0a362aa885500
Nov 03 21:47:28.060765 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.060714    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:28.060861 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.060800    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:28.060861 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.060846    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:28.100276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.100252    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:28.422890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.422862    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"]
Nov 03 21:47:28.424553 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:47:28.424527    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07098bf5_33d1_4d10_ad29_06a6703394f3.slice/crio-87a5862bb7db25240bb9c9f3d63387407d6769ae2532094b030e108e23311270 WatchSource:0}: Error finding container 87a5862bb7db25240bb9c9f3d63387407d6769ae2532094b030e108e23311270: Status 404 returned error can't find the container with id 87a5862bb7db25240bb9c9f3d63387407d6769ae2532094b030e108e23311270
Nov 03 21:47:28.427029 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.427011    6774 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 21:47:28.746335 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.746245    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn" event={"ID":"07098bf5-33d1-4d10-ad29-06a6703394f3","Type":"ContainerStarted","Data":"87a5862bb7db25240bb9c9f3d63387407d6769ae2532094b030e108e23311270"}
Nov 03 21:47:28.748324 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.748295    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" event={"ID":"7dcff539-ca9a-41bb-9be6-e8a658863884","Type":"ContainerStarted","Data":"0272d16d5841432d9843154030d363faa611f5e5ae96d2a64a51eab2667ad9d8"}
Nov 03 21:47:28.748494 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.748344    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" event={"ID":"7dcff539-ca9a-41bb-9be6-e8a658863884","Type":"ContainerStarted","Data":"270a3ac765667d4fe9df531284369503fab95703a1553c010ef0a362aa885500"}
Nov 03 21:47:28.797336 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:28.797281    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podStartSLOduration=3.797263716 podStartE2EDuration="3.797263716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:47:28.793994687 +0000 UTC m=+1018.760831465" watchObservedRunningTime="2026-11-03 21:47:28.797263716 +0000 UTC m=+1018.764100449"
Nov 03 21:47:29.483647 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.483611    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:29.484936 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.484913    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 21:47:29.485021 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.484962    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 21:47:29.931753 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.931722    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"]
Nov 03 21:47:29.935860 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.935840    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:29.974510 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.974476    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:29.974690 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.974533    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pgx\" (UniqueName: \"kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:29.974690 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.974552    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:29.976538 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.976513    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"]
Nov 03 21:47:29.985512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.985216    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 21:47:29.985512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:29.985366    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:47:30.075887 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.075833    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.076064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.075943    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pgx\" (UniqueName: \"kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.076064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.075976    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.076725 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.076697    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.079292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.079266    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.097103 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.097072    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pgx\" (UniqueName: \"kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx\") pod \"maas-api-revoke-sub-72df3e8f-827l8\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.303682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.303606    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:47:30.310165 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.310138    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:30.483935 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.483893    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 21:47:30.484129 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.483954    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 21:47:30.671695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.671653    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"]
Nov 03 21:47:30.799094 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:30.794071    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8" event={"ID":"08f6d7cc-6c48-4782-899e-08ebf18bb20f","Type":"ContainerStarted","Data":"e08573797d8a6c5606ed6629a4f72341db199abe8eb8d05ddb2592600716bee6"}
Nov 03 21:47:31.406174 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:47:31.406132    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:47:31.483640 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:31.483554    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 21:47:31.483828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:31.483634    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 21:47:31.800484 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:31.800386    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8" event={"ID":"08f6d7cc-6c48-4782-899e-08ebf18bb20f","Type":"ContainerStarted","Data":"4d41f8fffaa59c911aa368bfd8815a6be5d61d803b22e234865fefe99121a8db"}
Nov 03 21:47:31.867108 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:31.867059    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8" podStartSLOduration=2.86704269 podStartE2EDuration="2.86704269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:47:31.851005092 +0000 UTC m=+1021.817841855" watchObservedRunningTime="2026-11-03 21:47:31.86704269 +0000 UTC m=+1021.833879456"
Nov 03 21:47:32.483745 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:32.483712    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 21:47:32.484130 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:32.483771    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 21:47:32.819079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:32.818995    6774 generic.go:356] "Generic (PLEG): container finished" podID="08f6d7cc-6c48-4782-899e-08ebf18bb20f" containerID="4d41f8fffaa59c911aa368bfd8815a6be5d61d803b22e234865fefe99121a8db" exitCode=0
Nov 03 21:47:32.819079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:32.819035    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8" event={"ID":"08f6d7cc-6c48-4782-899e-08ebf18bb20f","Type":"ContainerDied","Data":"4d41f8fffaa59c911aa368bfd8815a6be5d61d803b22e234865fefe99121a8db"}
Nov 03 21:47:33.264334 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.264291    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:33.264456 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.264365    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:47:33.483379 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.483345    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 21:47:33.483540 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.483404    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 21:47:33.875628 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.875583    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn" event={"ID":"07098bf5-33d1-4d10-ad29-06a6703394f3","Type":"ContainerStarted","Data":"d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295"}
Nov 03 21:47:33.876061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.875677    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:33.985387 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:33.985310    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn" podStartSLOduration=2.149468755 podStartE2EDuration="6.985288546s" totalImagesPullingTime="4.835819791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:47:33.938909058 +0000 UTC m=+1023.905745793" watchObservedRunningTime="2026-11-03 21:47:33.985288546 +0000 UTC m=+1023.952125281"
Nov 03 21:47:34.123920 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.123888    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:34.201875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.201791    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca\") pod \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") "
Nov 03 21:47:34.202231 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.202206    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx\" (UniqueName: \"kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx\") pod \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") "
Nov 03 21:47:34.202401 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.202380    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca\") pod \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\" (UID: \"08f6d7cc-6c48-4782-899e-08ebf18bb20f\") "
Nov 03 21:47:34.203798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.203776    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca" pod "08f6d7cc-6c48-4782-899e-08ebf18bb20f" (UID: "08f6d7cc-6c48-4782-899e-08ebf18bb20f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:47:34.204001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.203975    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca" pod "08f6d7cc-6c48-4782-899e-08ebf18bb20f" (UID: "08f6d7cc-6c48-4782-899e-08ebf18bb20f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:34.205604 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.205580    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx" pod "08f6d7cc-6c48-4782-899e-08ebf18bb20f" (UID: "08f6d7cc-6c48-4782-899e-08ebf18bb20f"). InnerVolumeSpecName "kube-api-access-r4pgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:34.305296 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.305257    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:34.305296 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.305299    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4pgx\" (UniqueName: \"kubernetes.io/projected/08f6d7cc-6c48-4782-899e-08ebf18bb20f-kube-api-access-r4pgx\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:34.305540 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.305321    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/08f6d7cc-6c48-4782-899e-08ebf18bb20f-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:34.483816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.483731    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Nov 03 21:47:34.483953 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.483817    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Nov 03 21:47:34.544172 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.544136    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"]
Nov 03 21:47:34.544829 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.544809    6774 cpu_manager.go:414] "containerMap: removing container" podUID="08f6d7cc-6c48-4782-899e-08ebf18bb20f" containerName="revoke-keys"
Nov 03 21:47:34.544936 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.544829    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08f6d7cc-6c48-4782-899e-08ebf18bb20f" containerName="revoke-keys"
Nov 03 21:47:34.545025 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.545012    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="08f6d7cc-6c48-4782-899e-08ebf18bb20f" containerName="revoke-keys"
Nov 03 21:47:34.548716 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.548697    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.570228 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.570194    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"]
Nov 03 21:47:34.611723 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.611680    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7496n\" (UniqueName: \"kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.611892 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.611766    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.612022 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.611996    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.713276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.713235    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.713480 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.713365    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7496n\" (UniqueName: \"kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.713480 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.713403    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.714105 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.714077    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.715533 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.715513    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.736685 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.736620    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7496n\" (UniqueName: \"kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n\") pod \"maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.876498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.875840    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:34.894511 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.894468    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8" event={"ID":"08f6d7cc-6c48-4782-899e-08ebf18bb20f","Type":"ContainerDied","Data":"e08573797d8a6c5606ed6629a4f72341db199abe8eb8d05ddb2592600716bee6"}
Nov 03 21:47:34.894623 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.894539    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e08573797d8a6c5606ed6629a4f72341db199abe8eb8d05ddb2592600716bee6"
Nov 03 21:47:34.894682 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.894662    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"
Nov 03 21:47:34.918804 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:34.918773    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:47:35.228322 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:47:35.228280    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e496cc_6db2_4eb1_959b_ea8461d4936c.slice/crio-3607ee0de037bea4ad6be736509fcb51430106981e563610a0a4ccf6944f84f4 WatchSource:0}: Error finding container 3607ee0de037bea4ad6be736509fcb51430106981e563610a0a4ccf6944f84f4: Status 404 returned error can't find the container with id 3607ee0de037bea4ad6be736509fcb51430106981e563610a0a4ccf6944f84f4
Nov 03 21:47:35.228505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.228354    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"]
Nov 03 21:47:35.661263 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.661226    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:35.661689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.661665    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:35.662618 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.662602    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:47:35.904528 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.904488    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc" event={"ID":"b1e496cc-6db2-4eb1-959b-ea8461d4936c","Type":"ContainerStarted","Data":"db136d4886c9c35636285ec0a8265af52be09a64a84aea718db3b8c3f1a85565"}
Nov 03 21:47:35.905001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.904564    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc" event={"ID":"b1e496cc-6db2-4eb1-959b-ea8461d4936c","Type":"ContainerStarted","Data":"3607ee0de037bea4ad6be736509fcb51430106981e563610a0a4ccf6944f84f4"}
Nov 03 21:47:35.947443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:35.945305    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc" podStartSLOduration=1.9452881739999999 podStartE2EDuration="1.945288174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:47:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:47:35.942923845 +0000 UTC m=+1025.909760579" watchObservedRunningTime="2026-11-03 21:47:35.945288174 +0000 UTC m=+1025.912124909"
Nov 03 21:47:36.913448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:36.913390    6774 generic.go:356] "Generic (PLEG): container finished" podID="b1e496cc-6db2-4eb1-959b-ea8461d4936c" containerID="db136d4886c9c35636285ec0a8265af52be09a64a84aea718db3b8c3f1a85565" exitCode=0
Nov 03 21:47:36.913828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:36.913484    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc" event={"ID":"b1e496cc-6db2-4eb1-959b-ea8461d4936c","Type":"ContainerDied","Data":"db136d4886c9c35636285ec0a8265af52be09a64a84aea718db3b8c3f1a85565"}
Nov 03 21:47:37.949098 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:37.949048    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" containerID="cri-o://b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b" gracePeriod=45
Nov 03 21:47:38.026351 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.026279    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": dial tcp 10.134.0.57:8000: connect: connection refused"
Nov 03 21:47:38.087467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.087412    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:38.180149 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.180062    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca\") pod \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") "
Nov 03 21:47:38.180318 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.180243    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca\") pod \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") "
Nov 03 21:47:38.180385 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.180335    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n\" (UniqueName: \"kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n\") pod \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\" (UID: \"b1e496cc-6db2-4eb1-959b-ea8461d4936c\") "
Nov 03 21:47:38.180915 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.180878    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca" pod "b1e496cc-6db2-4eb1-959b-ea8461d4936c" (UID: "b1e496cc-6db2-4eb1-959b-ea8461d4936c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:47:38.183818 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.183786    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n" pod "b1e496cc-6db2-4eb1-959b-ea8461d4936c" (UID: "b1e496cc-6db2-4eb1-959b-ea8461d4936c"). InnerVolumeSpecName "kube-api-access-7496n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:38.183818 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.183765    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca" pod "b1e496cc-6db2-4eb1-959b-ea8461d4936c" (UID: "b1e496cc-6db2-4eb1-959b-ea8461d4936c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:38.225357 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.225323    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:47:38.282608 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.282568    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.282608 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.282602    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b1e496cc-6db2-4eb1-959b-ea8461d4936c-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.282608 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.282614    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7496n\" (UniqueName: \"kubernetes.io/projected/b1e496cc-6db2-4eb1-959b-ea8461d4936c-kube-api-access-7496n\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.383267 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383238    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache\") pod \"cd763424-4f56-483d-83ae-0f28d65ed8b8\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") "
Nov 03 21:47:38.383475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383377    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir\") pod \"cd763424-4f56-483d-83ae-0f28d65ed8b8\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") "
Nov 03 21:47:38.383557 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383505    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk\" (UniqueName: \"kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk\") pod \"cd763424-4f56-483d-83ae-0f28d65ed8b8\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") "
Nov 03 21:47:38.383557 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383546    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs\" (UniqueName: \"kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs\") pod \"cd763424-4f56-483d-83ae-0f28d65ed8b8\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") "
Nov 03 21:47:38.383664 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383565    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache" pod "cd763424-4f56-483d-83ae-0f28d65ed8b8" (UID: "cd763424-4f56-483d-83ae-0f28d65ed8b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:38.383664 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383595    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm\") pod \"cd763424-4f56-483d-83ae-0f28d65ed8b8\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") "
Nov 03 21:47:38.383664 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383626    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home\") pod \"cd763424-4f56-483d-83ae-0f28d65ed8b8\" (UID: \"cd763424-4f56-483d-83ae-0f28d65ed8b8\") "
Nov 03 21:47:38.383791 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383670    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir" pod "cd763424-4f56-483d-83ae-0f28d65ed8b8" (UID: "cd763424-4f56-483d-83ae-0f28d65ed8b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:38.383939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.383910    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home" pod "cd763424-4f56-483d-83ae-0f28d65ed8b8" (UID: "cd763424-4f56-483d-83ae-0f28d65ed8b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:38.384224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.384207    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.384295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.384253    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.384295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.384269    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.385846 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.385823    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm" pod "cd763424-4f56-483d-83ae-0f28d65ed8b8" (UID: "cd763424-4f56-483d-83ae-0f28d65ed8b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:38.385924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.385901    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk" pod "cd763424-4f56-483d-83ae-0f28d65ed8b8" (UID: "cd763424-4f56-483d-83ae-0f28d65ed8b8"). InnerVolumeSpecName "kube-api-access-ncskk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:38.386933 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.386914    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs" pod "cd763424-4f56-483d-83ae-0f28d65ed8b8" (UID: "cd763424-4f56-483d-83ae-0f28d65ed8b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:38.485760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.485677    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncskk\" (UniqueName: \"kubernetes.io/projected/cd763424-4f56-483d-83ae-0f28d65ed8b8-kube-api-access-ncskk\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.485760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.485709    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd763424-4f56-483d-83ae-0f28d65ed8b8-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.485760 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.485723    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd763424-4f56-483d-83ae-0f28d65ed8b8-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:38.928747 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.928706    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc" event={"ID":"b1e496cc-6db2-4eb1-959b-ea8461d4936c","Type":"ContainerDied","Data":"3607ee0de037bea4ad6be736509fcb51430106981e563610a0a4ccf6944f84f4"}
Nov 03 21:47:38.928747 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.928738    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"
Nov 03 21:47:38.928982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.928768    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3607ee0de037bea4ad6be736509fcb51430106981e563610a0a4ccf6944f84f4"
Nov 03 21:47:38.930210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.930182    6774 generic.go:356] "Generic (PLEG): container finished" podID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerID="b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b" exitCode=0
Nov 03 21:47:38.930354 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.930220    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"
Nov 03 21:47:38.930354 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.930262    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" event={"ID":"cd763424-4f56-483d-83ae-0f28d65ed8b8","Type":"ContainerDied","Data":"b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b"}
Nov 03 21:47:38.930354 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.930298    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx" event={"ID":"cd763424-4f56-483d-83ae-0f28d65ed8b8","Type":"ContainerDied","Data":"f7dd5d345996d8ab7670069ea9466c90dc7173a1e34ca4de8ec8712a3427917c"}
Nov 03 21:47:38.930354 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.930319    6774 scope.go:122] "RemoveContainer" containerID="b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b"
Nov 03 21:47:38.941366 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.941347    6774 scope.go:122] "RemoveContainer" containerID="b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b"
Nov 03 21:47:38.941648 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:47:38.941629    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b\": container with ID starting with b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b not found: ID does not exist" containerID="b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b"
Nov 03 21:47:38.941707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:38.941654    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b"} err="failed to get container status \"b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b\": rpc error: code = NotFound desc = could not find container \"b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b\": container with ID starting with b5fa8b9847e9f2c4bb6cd5dd2c2f0cf580ddd8ae8a7f954d4db77973dd93ff0b not found: ID does not exist"
Nov 03 21:47:39.002855 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:39.002824    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"]
Nov 03 21:47:39.005949 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:39.005930    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-dd5620/distinct-w3-dd5620-kserve-78cf99ff-nljtx"]
Nov 03 21:47:39.134822 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:39.134782    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"]
Nov 03 21:47:40.159690 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:40.159658    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" path="/var/lib/kubelet/pods/cd763424-4f56-483d-83ae-0f28d65ed8b8/volumes"
Nov 03 21:47:44.907306 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:44.907260    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"]
Nov 03 21:47:48.645432 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:48.645394    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"]
Nov 03 21:47:48.658732 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:48.658699    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"]
Nov 03 21:47:48.670956 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:48.670920    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"]
Nov 03 21:47:49.172878 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.172842    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"]
Nov 03 21:47:49.173091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.173048    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" podUID="4dd61259-091d-4548-8425-a848b9780120" containerName="maas-api" containerID="cri-o://060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a" gracePeriod=30
Nov 03 21:47:49.424328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.423501    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" podUID="4dd61259-091d-4548-8425-a848b9780120" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.42:8443/health\": dial tcp 10.134.0.42:8443: connect: connection refused"
Nov 03 21:47:49.744294 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.743316    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:47:49.808446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.807553    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx\" (UniqueName: \"kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx\") pod \"4dd61259-091d-4548-8425-a848b9780120\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") "
Nov 03 21:47:49.808446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.807631    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca\") pod \"4dd61259-091d-4548-8425-a848b9780120\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") "
Nov 03 21:47:49.808446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.807806    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs\") pod \"4dd61259-091d-4548-8425-a848b9780120\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") "
Nov 03 21:47:49.808446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.807906    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\") pod \"4dd61259-091d-4548-8425-a848b9780120\" (UID: \"4dd61259-091d-4548-8425-a848b9780120\") "
Nov 03 21:47:49.810934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.809613    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca" pod "4dd61259-091d-4548-8425-a848b9780120" (UID: "4dd61259-091d-4548-8425-a848b9780120"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:47:49.815448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.811266    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls" pod "4dd61259-091d-4548-8425-a848b9780120" (UID: "4dd61259-091d-4548-8425-a848b9780120"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:49.815448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.812155    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx" pod "4dd61259-091d-4548-8425-a848b9780120" (UID: "4dd61259-091d-4548-8425-a848b9780120"). InnerVolumeSpecName "kube-api-access-mr9xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:49.884567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.881113    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs" pod "4dd61259-091d-4548-8425-a848b9780120" (UID: "4dd61259-091d-4548-8425-a848b9780120"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:49.915810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.915688    6774 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dd61259-091d-4548-8425-a848b9780120-openshift-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:49.915810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.915727    6774 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-metrics-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:49.915810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.915740    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dd61259-091d-4548-8425-a848b9780120-maas-api-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:49.915810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.915754    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9xx\" (UniqueName: \"kubernetes.io/projected/4dd61259-091d-4548-8425-a848b9780120-kube-api-access-mr9xx\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:49.915810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:49.915803    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p" podUID="35527d13-8be1-46e8-a796-08fb7882a946" containerName="payload-pre-processing" containerID="cri-o://e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7" gracePeriod=25
Nov 03 21:47:50.015122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.015045    6774 generic.go:356] "Generic (PLEG): container finished" podID="4dd61259-091d-4548-8425-a848b9780120" containerID="060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a" exitCode=0
Nov 03 21:47:50.015122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.015108    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"
Nov 03 21:47:50.015331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.015164    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" event={"ID":"4dd61259-091d-4548-8425-a848b9780120","Type":"ContainerDied","Data":"060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a"}
Nov 03 21:47:50.015331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.015224    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk" event={"ID":"4dd61259-091d-4548-8425-a848b9780120","Type":"ContainerDied","Data":"faa82d22951a23c90703ca2f6b8b42d7bb9546f5164bdb8ff770b3694c83273e"}
Nov 03 21:47:50.015331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.015253    6774 scope.go:122] "RemoveContainer" containerID="060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a"
Nov 03 21:47:50.035183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.035152    6774 scope.go:122] "RemoveContainer" containerID="060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a"
Nov 03 21:47:50.035529 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:47:50.035498    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a\": container with ID starting with 060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a not found: ID does not exist" containerID="060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a"
Nov 03 21:47:50.035625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.035537    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a"} err="failed to get container status \"060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a\": rpc error: code = NotFound desc = could not find container \"060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a\": container with ID starting with 060daff9d00d418f55075c8f277c8506d560b1429055a36b893cba06fffb6f9a not found: ID does not exist"
Nov 03 21:47:50.070483 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.070449    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"]
Nov 03 21:47:50.085255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.085218    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dd5620-7db4b48c99-95wnk"]
Nov 03 21:47:50.162133 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.162095    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4dd61259-091d-4548-8425-a848b9780120" path="/var/lib/kubelet/pods/4dd61259-091d-4548-8425-a848b9780120/volumes"
Nov 03 21:47:50.190609 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.190585    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:47:50.218459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.218396    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume\") pod \"35527d13-8be1-46e8-a796-08fb7882a946\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") "
Nov 03 21:47:50.218615 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.218546    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5\" (UniqueName: \"kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5\") pod \"35527d13-8be1-46e8-a796-08fb7882a946\" (UID: \"35527d13-8be1-46e8-a796-08fb7882a946\") "
Nov 03 21:47:50.218776 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.218753    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume" pod "35527d13-8be1-46e8-a796-08fb7882a946" (UID: "35527d13-8be1-46e8-a796-08fb7882a946"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:47:50.219226 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.219209    6774 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35527d13-8be1-46e8-a796-08fb7882a946-plugins-config-volume\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:50.220904 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.220885    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5" pod "35527d13-8be1-46e8-a796-08fb7882a946" (UID: "35527d13-8be1-46e8-a796-08fb7882a946"). InnerVolumeSpecName "kube-api-access-tcgr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:50.320271 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.320178    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcgr5\" (UniqueName: \"kubernetes.io/projected/35527d13-8be1-46e8-a796-08fb7882a946-kube-api-access-tcgr5\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:50.519890 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:50.519858    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"]
Nov 03 21:47:51.023328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.023284    6774 generic.go:356] "Generic (PLEG): container finished" podID="35527d13-8be1-46e8-a796-08fb7882a946" containerID="e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7" exitCode=0
Nov 03 21:47:51.023328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.023326    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"
Nov 03 21:47:51.023868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.023332    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p" event={"ID":"35527d13-8be1-46e8-a796-08fb7882a946","Type":"ContainerDied","Data":"e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7"}
Nov 03 21:47:51.023868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.023390    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p" event={"ID":"35527d13-8be1-46e8-a796-08fb7882a946","Type":"ContainerDied","Data":"43fae864e2125e4f03cf3c0c65df96237f8f9552eacdea7f5ad9d3de5d0cc628"}
Nov 03 21:47:51.023868 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.023414    6774 scope.go:122] "RemoveContainer" containerID="e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7"
Nov 03 21:47:51.034923 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.034897    6774 scope.go:122] "RemoveContainer" containerID="e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7"
Nov 03 21:47:51.035497 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:47:51.035469    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7\": container with ID starting with e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7 not found: ID does not exist" containerID="e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7"
Nov 03 21:47:51.035660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.035628    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7"} err="failed to get container status \"e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7\": rpc error: code = NotFound desc = could not find container \"e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7\": container with ID starting with e88bbfd4d50c498d80b7ad9c5bea32dd81377a6409148d3f1075acf127e521a7 not found: ID does not exist"
Nov 03 21:47:51.086864 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.086832    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"]
Nov 03 21:47:51.099625 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:51.099599    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e246f9-7856b79db7-c9r4p"]
Nov 03 21:47:52.167903 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:52.167867    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35527d13-8be1-46e8-a796-08fb7882a946" path="/var/lib/kubelet/pods/35527d13-8be1-46e8-a796-08fb7882a946/volumes"
Nov 03 21:47:53.950977 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:53.950938    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"]
Nov 03 21:47:53.964477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:53.964450    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"]
Nov 03 21:47:54.158267 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.158225    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" containerID="cri-o://2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083" gracePeriod=45
Nov 03 21:47:54.326344 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.326306    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"]
Nov 03 21:47:54.455502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.455474    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:47:54.478929 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.478901    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg\" (UniqueName: \"kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg\") pod \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") "
Nov 03 21:47:54.479077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.478986    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache\") pod \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") "
Nov 03 21:47:54.479077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479009    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm\") pod \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") "
Nov 03 21:47:54.479077 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479064    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home\") pod \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") "
Nov 03 21:47:54.479204 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479119    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs\") pod \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") "
Nov 03 21:47:54.479260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479236    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache" pod "d2dbe4d6-b901-4b37-b7a0-40205b3df407" (UID: "d2dbe4d6-b901-4b37-b7a0-40205b3df407"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:54.479339 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479315    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir\") pod \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\" (UID: \"d2dbe4d6-b901-4b37-b7a0-40205b3df407\") "
Nov 03 21:47:54.479556 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479535    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home" pod "d2dbe4d6-b901-4b37-b7a0-40205b3df407" (UID: "d2dbe4d6-b901-4b37-b7a0-40205b3df407"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:54.479677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.479629    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir" pod "d2dbe4d6-b901-4b37-b7a0-40205b3df407" (UID: "d2dbe4d6-b901-4b37-b7a0-40205b3df407"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:54.480067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.480045    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:54.480167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.480074    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:54.480167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.480088    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:54.481323 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.481299    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm" pod "d2dbe4d6-b901-4b37-b7a0-40205b3df407" (UID: "d2dbe4d6-b901-4b37-b7a0-40205b3df407"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:47:54.481413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.481381    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs" pod "d2dbe4d6-b901-4b37-b7a0-40205b3df407" (UID: "d2dbe4d6-b901-4b37-b7a0-40205b3df407"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:47:54.481480 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.481444    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg" pod "d2dbe4d6-b901-4b37-b7a0-40205b3df407" (UID: "d2dbe4d6-b901-4b37-b7a0-40205b3df407"). InnerVolumeSpecName "kube-api-access-qk8mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:47:54.582345 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.582256    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk8mg\" (UniqueName: \"kubernetes.io/projected/d2dbe4d6-b901-4b37-b7a0-40205b3df407-kube-api-access-qk8mg\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:54.582345 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.582296    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2dbe4d6-b901-4b37-b7a0-40205b3df407-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:54.582345 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:54.582312    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2dbe4d6-b901-4b37-b7a0-40205b3df407-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:47:55.058710 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.058675    6774 generic.go:356] "Generic (PLEG): container finished" podID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerID="2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083" exitCode=0
Nov 03 21:47:55.059230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.058735    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"
Nov 03 21:47:55.059230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.058787    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" event={"ID":"d2dbe4d6-b901-4b37-b7a0-40205b3df407","Type":"ContainerDied","Data":"2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083"}
Nov 03 21:47:55.059230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.058840    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" event={"ID":"d2dbe4d6-b901-4b37-b7a0-40205b3df407","Type":"ContainerDied","Data":"4178f02962b415510e02a5d0f18f868cefe1baf5bb7ec53866555fc38646a7be"}
Nov 03 21:47:55.059230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.058861    6774 scope.go:122] "RemoveContainer" containerID="2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083"
Nov 03 21:47:55.071730 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.071710    6774 scope.go:122] "RemoveContainer" containerID="2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083"
Nov 03 21:47:55.072102 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:47:55.072072    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083\": container with ID starting with 2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083 not found: ID does not exist" containerID="2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083"
Nov 03 21:47:55.072224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.072126    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083"} err="failed to get container status \"2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083\": rpc error: code = NotFound desc = could not find container \"2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083\": container with ID starting with 2bc11a5d42b7133932b144840cea907f87a094c72469069541a249c863bd1083 not found: ID does not exist"
Nov 03 21:47:55.114146 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.114114    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"]
Nov 03 21:47:55.126880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.126853    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb"]
Nov 03 21:47:55.357711 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:55.357666    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-e246f9/simulator-w0-e246f9-kserve-58645d5fb7-lwwcb" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main" probeResult="failure" output="Get \"https://10.134.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:56.169916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.166764    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" path="/var/lib/kubelet/pods/d2dbe4d6-b901-4b37-b7a0-40205b3df407/volumes"
Nov 03 21:47:56.985109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.985061    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"]
Nov 03 21:47:56.986155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986132    6774 cpu_manager.go:414] "containerMap: removing container" podUID="35527d13-8be1-46e8-a796-08fb7882a946" containerName="payload-pre-processing"
Nov 03 21:47:56.986278 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986266    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35527d13-8be1-46e8-a796-08fb7882a946" containerName="payload-pre-processing"
Nov 03 21:47:56.986408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986397    6774 cpu_manager.go:414] "containerMap: removing container" podUID="b1e496cc-6db2-4eb1-959b-ea8461d4936c" containerName="revoke-keys"
Nov 03 21:47:56.986509 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986498    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1e496cc-6db2-4eb1-959b-ea8461d4936c" containerName="revoke-keys"
Nov 03 21:47:56.986587 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986579    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4dd61259-091d-4548-8425-a848b9780120" containerName="maas-api"
Nov 03 21:47:56.986656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986647    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4dd61259-091d-4548-8425-a848b9780120" containerName="maas-api"
Nov 03 21:47:56.986740 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986732    6774 cpu_manager.go:414] "containerMap: removing container" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main"
Nov 03 21:47:56.986807 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986797    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main"
Nov 03 21:47:56.986908 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986900    6774 cpu_manager.go:414] "containerMap: removing container" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main"
Nov 03 21:47:56.986975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.986966    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main"
Nov 03 21:47:56.987189 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.987180    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1e496cc-6db2-4eb1-959b-ea8461d4936c" containerName="revoke-keys"
Nov 03 21:47:56.987266 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.987258    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd763424-4f56-483d-83ae-0f28d65ed8b8" containerName="main"
Nov 03 21:47:56.987335 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.987327    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4dd61259-091d-4548-8425-a848b9780120" containerName="maas-api"
Nov 03 21:47:56.987401 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.987394    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2dbe4d6-b901-4b37-b7a0-40205b3df407" containerName="main"
Nov 03 21:47:56.987545 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:56.987533    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="35527d13-8be1-46e8-a796-08fb7882a946" containerName="payload-pre-processing"
Nov 03 21:47:57.059910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.059874    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"]
Nov 03 21:47:57.060366 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.060345    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.078907 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.078879    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:47:57.079318 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.079297    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 21:47:57.180956 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.179112    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.181659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.181632    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lkl\" (UniqueName: \"kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.181980 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.181939    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.292502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.291624    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.292502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.291720    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lkl\" (UniqueName: \"kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.292502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.291906    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.316696 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.297233    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.316696 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.300746    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.358446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.338241    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lkl\" (UniqueName: \"kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl\") pod \"maas-api-revoke-sub-a24d85e3-dkc78\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.475446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.474672    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:47:57.915586 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.909480    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"]
Nov 03 21:47:57.915586 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:57.909783    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy" containerID="cri-o://7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3" gracePeriod=30
Nov 03 21:47:58.134887 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:58.134857    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"]
Nov 03 21:47:58.135347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:58.135319    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" containerID="cri-o://a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d" gracePeriod=30
Nov 03 21:47:58.582455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:58.581778    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Nov 03 21:47:58.620930 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:58.620451    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:58.841589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:58.825479    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:58.986925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:58.983824    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:59.193003 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.192964    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:59.201529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.199843    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"]
Nov 03 21:47:59.336530 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.329923    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerName="payload-pre-processing" containerID="cri-o://a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc" gracePeriod=25
Nov 03 21:47:59.383935 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.383883    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" probeResult="failure" output="Get \"https://10.134.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:59.447250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.447197    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78" event={"ID":"be2442bc-38e8-4480-8343-54145dd6265a","Type":"ContainerStarted","Data":"544fbab34b3c598713a1c3f07bc915fabb38aa2f2254a53e1050b4b890c2a096"}
Nov 03 21:47:59.582639 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.582578    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:59.584004 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.583978    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:47:59.621571 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.621516    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:47:59.638487 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.627866    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:47:59.722457 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.712915    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:47:59.862879 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.862825    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" probeResult="failure" output="Get \"https://10.134.0.49:8000/ready\": context deadline exceeded"
Nov 03 21:47:59.889864 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:47:59.889833    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:48:00.258126 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:00.258066    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" probeResult="failure" output="Get \"https://10.134.0.47:8000/health\": context deadline exceeded"
Nov 03 21:48:00.580189 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:00.580143    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:48:00.608461 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:00.607206    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:48:00.609980 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:00.609935    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.52:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:48:01.015795 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:01.015761    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"]
Nov 03 21:48:01.432084 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:01.429565    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:48:01.654440 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:01.654387    6774 generic.go:356] "Generic (PLEG): container finished" podID="be2442bc-38e8-4480-8343-54145dd6265a" containerID="c9790cafde616f94dd536fb7dd7f2c1230956f4fcca8b00a07e21aada63a72b3" exitCode=0
Nov 03 21:48:01.654886 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:01.654461    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78" event={"ID":"be2442bc-38e8-4480-8343-54145dd6265a","Type":"ContainerDied","Data":"c9790cafde616f94dd536fb7dd7f2c1230956f4fcca8b00a07e21aada63a72b3"}
Nov 03 21:48:02.377319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.377281    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:48:02.814092 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.814061    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:48:02.904120 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.904076    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl\" (UniqueName: \"kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl\") pod \"be2442bc-38e8-4480-8343-54145dd6265a\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") "
Nov 03 21:48:02.904285 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.904147    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca\") pod \"be2442bc-38e8-4480-8343-54145dd6265a\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") "
Nov 03 21:48:02.904331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.904293    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca\") pod \"be2442bc-38e8-4480-8343-54145dd6265a\" (UID: \"be2442bc-38e8-4480-8343-54145dd6265a\") "
Nov 03 21:48:02.904694 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.904663    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca" pod "be2442bc-38e8-4480-8343-54145dd6265a" (UID: "be2442bc-38e8-4480-8343-54145dd6265a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:02.904934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.904915    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:02.906135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.906106    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl" pod "be2442bc-38e8-4480-8343-54145dd6265a" (UID: "be2442bc-38e8-4480-8343-54145dd6265a"). InnerVolumeSpecName "kube-api-access-k2lkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:02.906224 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:02.906203    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca" pod "be2442bc-38e8-4480-8343-54145dd6265a" (UID: "be2442bc-38e8-4480-8343-54145dd6265a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:03.006659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.006620    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2lkl\" (UniqueName: \"kubernetes.io/projected/be2442bc-38e8-4480-8343-54145dd6265a-kube-api-access-k2lkl\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.006659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.006654    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/be2442bc-38e8-4480-8343-54145dd6265a-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.254586 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.254544    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"]
Nov 03 21:48:03.255334 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.255310    6774 cpu_manager.go:414] "containerMap: removing container" podUID="be2442bc-38e8-4480-8343-54145dd6265a" containerName="revoke-keys"
Nov 03 21:48:03.255334 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.255331    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be2442bc-38e8-4480-8343-54145dd6265a" containerName="revoke-keys"
Nov 03 21:48:03.255549 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.255440    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="be2442bc-38e8-4480-8343-54145dd6265a" containerName="revoke-keys"
Nov 03 21:48:03.258850 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.258829    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.280645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.280612    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"]
Nov 03 21:48:03.413491 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.413452    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.413661 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.413506    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mwk\" (UniqueName: \"kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.413806 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.413779    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.424974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.424952    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:48:03.514978 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.514893    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.515131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515024    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.515131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515057    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.515131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515117    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.515292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515187    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.515292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515237    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515358    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515396    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515404    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515460    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515515    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert\") pod \"aa18ab08-a905-4430-ac47-373798ebf7f7\" (UID: \"aa18ab08-a905-4430-ac47-373798ebf7f7\") "
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.515800    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516020    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516092    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516130    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mwk\" (UniqueName: \"kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516317    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516414    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516449    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516463    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516478    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.517048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.516872    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:03.517922 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.517071    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.517922 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.517908    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "kube-api-access-htblf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:03.518029 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.517934    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:03.518029 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.517946    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:03.518276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.518257    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo" pod "aa18ab08-a905-4430-ac47-373798ebf7f7" (UID: "aa18ab08-a905-4430-ac47-373798ebf7f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:03.519812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.519793    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.544720 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.544684    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mwk\" (UniqueName: \"kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk\") pod \"maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.574277 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.574240    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:03.618182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.618043    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htblf\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-kube-api-access-htblf\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.618182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.618088    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.618182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.618104    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.618182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.618118    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa18ab08-a905-4430-ac47-373798ebf7f7-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.618182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.618130    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa18ab08-a905-4430-ac47-373798ebf7f7-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:03.668492 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.668367    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main" containerID="cri-o://5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e" gracePeriod=45
Nov 03 21:48:03.674562 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.674532    6774 generic.go:356] "Generic (PLEG): container finished" podID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerID="7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3" exitCode=0
Nov 03 21:48:03.674688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.674604    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"
Nov 03 21:48:03.674688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.674621    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" event={"ID":"aa18ab08-a905-4430-ac47-373798ebf7f7","Type":"ContainerDied","Data":"7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3"}
Nov 03 21:48:03.674817 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.674723    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s" event={"ID":"aa18ab08-a905-4430-ac47-373798ebf7f7","Type":"ContainerDied","Data":"93c69d23147d2dbc83fa05e97a7ddcc7a7e4b8795fa9f8451bd734ec0049397c"}
Nov 03 21:48:03.674817 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.674757    6774 scope.go:122] "RemoveContainer" containerID="7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3"
Nov 03 21:48:03.676282 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.676259    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78" event={"ID":"be2442bc-38e8-4480-8343-54145dd6265a","Type":"ContainerDied","Data":"544fbab34b3c598713a1c3f07bc915fabb38aa2f2254a53e1050b4b890c2a096"}
Nov 03 21:48:03.676404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.676303    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="544fbab34b3c598713a1c3f07bc915fabb38aa2f2254a53e1050b4b890c2a096"
Nov 03 21:48:03.676404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.676269    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"
Nov 03 21:48:03.681210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.681179    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main" containerID="cri-o://06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f" gracePeriod=45
Nov 03 21:48:03.687302 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.687283    6774 scope.go:122] "RemoveContainer" containerID="7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3"
Nov 03 21:48:03.687654 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:03.687633    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3\": container with ID starting with 7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3 not found: ID does not exist" containerID="7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3"
Nov 03 21:48:03.687719 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.687663    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3"} err="failed to get container status \"7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3\": rpc error: code = NotFound desc = could not find container \"7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3\": container with ID starting with 7ebffe28eae747713474bc4f764f3fce87347265f3e22abe7342c84a18192fb3 not found: ID does not exist"
Nov 03 21:48:03.692353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.692322    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" containerID="cri-o://18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e" gracePeriod=45
Nov 03 21:48:03.827093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.827052    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main" probeResult="failure" output="Get \"https://10.134.0.48:8000/ready\": dial tcp 10.134.0.48:8000: connect: connection refused"
Nov 03 21:48:03.878642 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.878611    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"]
Nov 03 21:48:03.907693 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.907646    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"]
Nov 03 21:48:03.911186 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:03.911159    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-8w55s"]
Nov 03 21:48:04.021522 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.020453    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:48:04.032321 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.032292    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:48:04.034449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.034407    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:48:04.125798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.125764    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache\") pod \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") "
Nov 03 21:48:04.125983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.125817    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home\") pod \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") "
Nov 03 21:48:04.125983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.125866    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home\") pod \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") "
Nov 03 21:48:04.125983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.125919    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache\") pod \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") "
Nov 03 21:48:04.125983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.125951    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs\" (UniqueName: \"kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs\") pod \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") "
Nov 03 21:48:04.125983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.125978    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs\" (UniqueName: \"kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs\") pod \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126016    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs\") pod \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126036    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q\" (UniqueName: \"kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q\") pod \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126072    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm\") pod \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126112    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx\" (UniqueName: \"kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx\") pod \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126175    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p\" (UniqueName: \"kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p\") pod \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126207    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir\") pod \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") "
Nov 03 21:48:04.126250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126244    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir\") pod \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") "
Nov 03 21:48:04.126582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126291    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home\") pod \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") "
Nov 03 21:48:04.126582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126359    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache\") pod \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") "
Nov 03 21:48:04.126582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126397    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm\") pod \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\" (UID: \"7ab9e918-e21e-4a49-9015-66ecfed84b9c\") "
Nov 03 21:48:04.126582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126397    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home" pod "1e04a239-1f27-43b1-9599-9b2c8581e4d6" (UID: "1e04a239-1f27-43b1-9599-9b2c8581e4d6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.126582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126442    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm\") pod \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\" (UID: \"1e04a239-1f27-43b1-9599-9b2c8581e4d6\") "
Nov 03 21:48:04.126582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126580    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir\") pod \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\" (UID: \"d6607d9a-18fc-42ba-99ab-75cef05fdf22\") "
Nov 03 21:48:04.126865 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126685    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir" pod "1e04a239-1f27-43b1-9599-9b2c8581e4d6" (UID: "1e04a239-1f27-43b1-9599-9b2c8581e4d6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.126917 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.126894    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache" pod "1e04a239-1f27-43b1-9599-9b2c8581e4d6" (UID: "1e04a239-1f27-43b1-9599-9b2c8581e4d6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.127110    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir" pod "7ab9e918-e21e-4a49-9015-66ecfed84b9c" (UID: "7ab9e918-e21e-4a49-9015-66ecfed84b9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.127236    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home" pod "d6607d9a-18fc-42ba-99ab-75cef05fdf22" (UID: "d6607d9a-18fc-42ba-99ab-75cef05fdf22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.127335    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache" pod "d6607d9a-18fc-42ba-99ab-75cef05fdf22" (UID: "d6607d9a-18fc-42ba-99ab-75cef05fdf22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.127327    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home" pod "7ab9e918-e21e-4a49-9015-66ecfed84b9c" (UID: "7ab9e918-e21e-4a49-9015-66ecfed84b9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.127683    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir" pod "d6607d9a-18fc-42ba-99ab-75cef05fdf22" (UID: "d6607d9a-18fc-42ba-99ab-75cef05fdf22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.127771    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache" pod "7ab9e918-e21e-4a49-9015-66ecfed84b9c" (UID: "7ab9e918-e21e-4a49-9015-66ecfed84b9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128327    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128353    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128366    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128379    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128391    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128403    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128415    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128462    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.128500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.128477    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.130415 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.130383    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm" pod "7ab9e918-e21e-4a49-9015-66ecfed84b9c" (UID: "7ab9e918-e21e-4a49-9015-66ecfed84b9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.131608 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.131574    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm" pod "1e04a239-1f27-43b1-9599-9b2c8581e4d6" (UID: "1e04a239-1f27-43b1-9599-9b2c8581e4d6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.133866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.133756    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm" pod "d6607d9a-18fc-42ba-99ab-75cef05fdf22" (UID: "d6607d9a-18fc-42ba-99ab-75cef05fdf22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:04.133866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.133765    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs" pod "7ab9e918-e21e-4a49-9015-66ecfed84b9c" (UID: "7ab9e918-e21e-4a49-9015-66ecfed84b9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:04.133866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.133777    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs" pod "1e04a239-1f27-43b1-9599-9b2c8581e4d6" (UID: "1e04a239-1f27-43b1-9599-9b2c8581e4d6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:04.133866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.133818    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs" pod "d6607d9a-18fc-42ba-99ab-75cef05fdf22" (UID: "d6607d9a-18fc-42ba-99ab-75cef05fdf22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:04.133866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.133822    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q" pod "d6607d9a-18fc-42ba-99ab-75cef05fdf22" (UID: "d6607d9a-18fc-42ba-99ab-75cef05fdf22"). InnerVolumeSpecName "kube-api-access-jd52q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:04.133866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.133851    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx" pod "1e04a239-1f27-43b1-9599-9b2c8581e4d6" (UID: "1e04a239-1f27-43b1-9599-9b2c8581e4d6"). InnerVolumeSpecName "kube-api-access-q28lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:04.135011 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.134982    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p" pod "7ab9e918-e21e-4a49-9015-66ecfed84b9c" (UID: "7ab9e918-e21e-4a49-9015-66ecfed84b9c"). InnerVolumeSpecName "kube-api-access-5xq9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:04.164059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.164022    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" path="/var/lib/kubelet/pods/aa18ab08-a905-4430-ac47-373798ebf7f7/volumes"
Nov 03 21:48:04.200569 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.200530    6774 patch_prober.go:29] interesting pod/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Nov 03 21:48:04.200736 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.200599    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:04.230501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230464    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e04a239-1f27-43b1-9599-9b2c8581e4d6-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230501 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230499    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6607d9a-18fc-42ba-99ab-75cef05fdf22-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230514    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab9e918-e21e-4a49-9015-66ecfed84b9c-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230530    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd52q\" (UniqueName: \"kubernetes.io/projected/d6607d9a-18fc-42ba-99ab-75cef05fdf22-kube-api-access-jd52q\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230544    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6607d9a-18fc-42ba-99ab-75cef05fdf22-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230557    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q28lx\" (UniqueName: \"kubernetes.io/projected/1e04a239-1f27-43b1-9599-9b2c8581e4d6-kube-api-access-q28lx\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230571    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xq9p\" (UniqueName: \"kubernetes.io/projected/7ab9e918-e21e-4a49-9015-66ecfed84b9c-kube-api-access-5xq9p\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230584    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab9e918-e21e-4a49-9015-66ecfed84b9c-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.230692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.230597    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e04a239-1f27-43b1-9599-9b2c8581e4d6-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:04.291463 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.291372    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"]
Nov 03 21:48:04.291982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.291966    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main"
Nov 03 21:48:04.292019 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.291983    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main"
Nov 03 21:48:04.292069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292032    6774 cpu_manager.go:414] "containerMap: removing container" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main"
Nov 03 21:48:04.292069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292037    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main"
Nov 03 21:48:04.292069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292046    6774 cpu_manager.go:414] "containerMap: removing container" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy"
Nov 03 21:48:04.292069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292051    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy"
Nov 03 21:48:04.292069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292059    6774 cpu_manager.go:414] "containerMap: removing container" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main"
Nov 03 21:48:04.292069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292064    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main"
Nov 03 21:48:04.292313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292141    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerName="main"
Nov 03 21:48:04.292313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292149    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa18ab08-a905-4430-ac47-373798ebf7f7" containerName="istio-proxy"
Nov 03 21:48:04.292313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292156    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerName="main"
Nov 03 21:48:04.292313 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.292162    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerName="main"
Nov 03 21:48:04.295748 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.295723    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.313888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.313852    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"]
Nov 03 21:48:04.432645 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.432613    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.432828 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.432667    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2prj\" (UniqueName: \"kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.432922 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.432897    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.534642 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.534606    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.534817 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.534664    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2prj\" (UniqueName: \"kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.534817 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.534784    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.535402 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.535373    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.536934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.536913    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.554755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.554692    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2prj\" (UniqueName: \"kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj\") pod \"maas-api-revoke-sub-c0a06a41-t9qfc\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.610467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.610409    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:04.691201 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.690831    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv" event={"ID":"310d18ab-d068-4bd1-bb1a-73dab67664f0","Type":"ContainerStarted","Data":"444382e468909f1b6f10de71cf57b96a596da71aaebf638b4b5dbe74bd6ea3c2"}
Nov 03 21:48:04.691201 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.690880    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv" event={"ID":"310d18ab-d068-4bd1-bb1a-73dab67664f0","Type":"ContainerStarted","Data":"eec1f271cce89174fae0d6e81e8a08dee724deaa4b576b0672f9f1e2a84e522c"}
Nov 03 21:48:04.692534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.692339    6774 generic.go:356] "Generic (PLEG): container finished" podID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" containerID="5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e" exitCode=0
Nov 03 21:48:04.692534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.692373    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"
Nov 03 21:48:04.692534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.692431    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" event={"ID":"7ab9e918-e21e-4a49-9015-66ecfed84b9c","Type":"ContainerDied","Data":"5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e"}
Nov 03 21:48:04.692534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.692466    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s" event={"ID":"7ab9e918-e21e-4a49-9015-66ecfed84b9c","Type":"ContainerDied","Data":"0d2cd350543a586714729bcfd69dcd006b82dece873cc4fd7d158f4accec4091"}
Nov 03 21:48:04.692534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.692486    6774 scope.go:122] "RemoveContainer" containerID="5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e"
Nov 03 21:48:04.694100 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.694073    6774 generic.go:356] "Generic (PLEG): container finished" podID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" containerID="18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e" exitCode=0
Nov 03 21:48:04.694197 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.694164    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" event={"ID":"d6607d9a-18fc-42ba-99ab-75cef05fdf22","Type":"ContainerDied","Data":"18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e"}
Nov 03 21:48:04.694197 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.694185    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9" event={"ID":"d6607d9a-18fc-42ba-99ab-75cef05fdf22","Type":"ContainerDied","Data":"b0d9fe063fd803cac77bfbee2b76babe327787e6106c3b49245584a06e461ae3"}
Nov 03 21:48:04.694317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.694238    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"
Nov 03 21:48:04.696333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.696315    6774 generic.go:356] "Generic (PLEG): container finished" podID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" containerID="06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f" exitCode=0
Nov 03 21:48:04.696333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.696339    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" event={"ID":"1e04a239-1f27-43b1-9599-9b2c8581e4d6","Type":"ContainerDied","Data":"06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f"}
Nov 03 21:48:04.696524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.696358    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7" event={"ID":"1e04a239-1f27-43b1-9599-9b2c8581e4d6","Type":"ContainerDied","Data":"841f08976de51542debf2bd291dad691d9d4442fdcc93e07da479b2785e7446e"}
Nov 03 21:48:04.696524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.696395    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"
Nov 03 21:48:04.717605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.717575    6774 scope.go:122] "RemoveContainer" containerID="5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e"
Nov 03 21:48:04.718083 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:04.717954    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e\": container with ID starting with 5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e not found: ID does not exist" containerID="5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e"
Nov 03 21:48:04.718083 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.717988    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e"} err="failed to get container status \"5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e\": rpc error: code = NotFound desc = could not find container \"5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e\": container with ID starting with 5e243b3de2a2a42c0efe1fecf43b59a6953dd60fefcd65e1a596dc8e33d4060e not found: ID does not exist"
Nov 03 21:48:04.718083 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.718007    6774 scope.go:122] "RemoveContainer" containerID="18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e"
Nov 03 21:48:04.729008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.728600    6774 scope.go:122] "RemoveContainer" containerID="18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e"
Nov 03 21:48:04.729008 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:04.728938    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e\": container with ID starting with 18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e not found: ID does not exist" containerID="18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e"
Nov 03 21:48:04.729008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.728972    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e"} err="failed to get container status \"18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e\": rpc error: code = NotFound desc = could not find container \"18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e\": container with ID starting with 18da34261a0125c19ec795ad3f9eaa36919485f3b7210cd3f426658ace5ed48e not found: ID does not exist"
Nov 03 21:48:04.729008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.728996    6774 scope.go:122] "RemoveContainer" containerID="06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f"
Nov 03 21:48:04.735282 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.735228    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv" podStartSLOduration=1.735211048 podStartE2EDuration="1.735211048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:48:04.730883625 +0000 UTC m=+1054.697720360" watchObservedRunningTime="2026-11-03 21:48:04.735211048 +0000 UTC m=+1054.702047783"
Nov 03 21:48:04.743087 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.743065    6774 scope.go:122] "RemoveContainer" containerID="06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f"
Nov 03 21:48:04.743503 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:04.743434    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f\": container with ID starting with 06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f not found: ID does not exist" containerID="06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f"
Nov 03 21:48:04.743503 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.743473    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f"} err="failed to get container status \"06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f\": rpc error: code = NotFound desc = could not find container \"06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f\": container with ID starting with 06b1fe6fed7bcbaf76f6691194c5a0b4aca8c5851c98bcad158e754b134fbf9f not found: ID does not exist"
Nov 03 21:48:04.772652 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.772617    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"]
Nov 03 21:48:04.775626 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.775603    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/distinct-2-w5-0a6da1-kserve-766fcd95f6-xhq6s"]
Nov 03 21:48:04.812025 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.811937    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"]
Nov 03 21:48:04.814863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.814833    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/simulator-w5-0a6da1-kserve-6d7796b49-drxc9"]
Nov 03 21:48:04.850530 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.850499    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"]
Nov 03 21:48:04.853360 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.853332    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-0a6da1/premium-w5-0a6da1-kserve-5dd88dfc48-dhjr7"]
Nov 03 21:48:04.911065 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:04.911039    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"]
Nov 03 21:48:04.911647 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:48:04.911625    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb2c331_29ef_4cb6_b42a_e20cfed79499.slice/crio-1a6a79f26f6f7663fc318774502f38de5d6e36da160e9a176f075d1840b4f680 WatchSource:0}: Error finding container 1a6a79f26f6f7663fc318774502f38de5d6e36da160e9a176f075d1840b4f680: Status 404 returned error can't find the container with id 1a6a79f26f6f7663fc318774502f38de5d6e36da160e9a176f075d1840b4f680
Nov 03 21:48:05.553376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.553281    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" containerID="cri-o://adecdf77d76eb20a4113b2ce380d940a4fc7f4e841f9e60905715a8234073225" gracePeriod=45
Nov 03 21:48:05.592324 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.592276    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main" probeResult="failure" output="Get \"https://10.134.0.46:8000/ready\": dial tcp 10.134.0.46:8000: connect: connection refused"
Nov 03 21:48:05.705953 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.705924    6774 generic.go:356] "Generic (PLEG): container finished" podID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerID="adecdf77d76eb20a4113b2ce380d940a4fc7f4e841f9e60905715a8234073225" exitCode=0
Nov 03 21:48:05.706130 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.706000    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" event={"ID":"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e","Type":"ContainerDied","Data":"adecdf77d76eb20a4113b2ce380d940a4fc7f4e841f9e60905715a8234073225"}
Nov 03 21:48:05.707712 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.707685    6774 generic.go:356] "Generic (PLEG): container finished" podID="310d18ab-d068-4bd1-bb1a-73dab67664f0" containerID="444382e468909f1b6f10de71cf57b96a596da71aaebf638b4b5dbe74bd6ea3c2" exitCode=0
Nov 03 21:48:05.707835 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.707752    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv" event={"ID":"310d18ab-d068-4bd1-bb1a-73dab67664f0","Type":"ContainerDied","Data":"444382e468909f1b6f10de71cf57b96a596da71aaebf638b4b5dbe74bd6ea3c2"}
Nov 03 21:48:05.712449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.712395    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc" event={"ID":"9eb2c331-29ef-4cb6-b42a-e20cfed79499","Type":"ContainerStarted","Data":"24d1469613670c82cfda6109de6899fb2cd81b3d7fd23d54837a3dadcd06456f"}
Nov 03 21:48:05.712538 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.712471    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc" event={"ID":"9eb2c331-29ef-4cb6-b42a-e20cfed79499","Type":"ContainerStarted","Data":"1a6a79f26f6f7663fc318774502f38de5d6e36da160e9a176f075d1840b4f680"}
Nov 03 21:48:05.792062 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.792007    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc" podStartSLOduration=1.791990809 podStartE2EDuration="1.791990809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:48:05.786784845 +0000 UTC m=+1055.753621611" watchObservedRunningTime="2026-11-03 21:48:05.791990809 +0000 UTC m=+1055.758827534"
Nov 03 21:48:05.818046 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.818020    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:48:05.956777 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.956744    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g\" (UniqueName: \"kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g\") pod \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") "
Nov 03 21:48:05.957163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.956822    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm\") pod \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") "
Nov 03 21:48:05.957163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.956887    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home\") pod \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") "
Nov 03 21:48:05.957163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.956954    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache\") pod \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") "
Nov 03 21:48:05.957163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.956999    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs\" (UniqueName: \"kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs\") pod \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") "
Nov 03 21:48:05.957163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957034    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir\") pod \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\" (UID: \"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e\") "
Nov 03 21:48:05.957479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957175    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home" pod "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" (UID: "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:05.957479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957215    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache" pod "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" (UID: "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:05.957479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957466    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir" pod "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" (UID: "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:05.957751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957734    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:05.957751 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957751    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:05.957875 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.957760    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:05.959203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.959175    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs" pod "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" (UID: "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:05.960299 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.960274    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g" pod "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" (UID: "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e"). InnerVolumeSpecName "kube-api-access-khq6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:05.960395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:05.960341    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm" pod "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" (UID: "e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:06.019657 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.019520    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w" podUID="bcfdf623-99f3-42ec-94b2-6938435b9d8e" containerName="payload-processing" containerID="cri-o://dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a" gracePeriod=25
Nov 03 21:48:06.059278 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.059202    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khq6g\" (UniqueName: \"kubernetes.io/projected/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-kube-api-access-khq6g\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.059278 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.059235    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.059278 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.059246    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.168073 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.168036    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e04a239-1f27-43b1-9599-9b2c8581e4d6" path="/var/lib/kubelet/pods/1e04a239-1f27-43b1-9599-9b2c8581e4d6/volumes"
Nov 03 21:48:06.168888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.168862    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ab9e918-e21e-4a49-9015-66ecfed84b9c" path="/var/lib/kubelet/pods/7ab9e918-e21e-4a49-9015-66ecfed84b9c/volumes"
Nov 03 21:48:06.169520 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.169496    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6607d9a-18fc-42ba-99ab-75cef05fdf22" path="/var/lib/kubelet/pods/d6607d9a-18fc-42ba-99ab-75cef05fdf22/volumes"
Nov 03 21:48:06.275067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.275022    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"]
Nov 03 21:48:06.341563 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.341527    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:48:06.389035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.389005    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:48:06.464946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.464911    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss\" (UniqueName: \"kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss\") pod \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") "
Nov 03 21:48:06.465155 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.464995    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume\") pod \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\" (UID: \"bcfdf623-99f3-42ec-94b2-6938435b9d8e\") "
Nov 03 21:48:06.465495 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.465465    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume" pod "bcfdf623-99f3-42ec-94b2-6938435b9d8e" (UID: "bcfdf623-99f3-42ec-94b2-6938435b9d8e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:06.465950 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.465923    6774 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcfdf623-99f3-42ec-94b2-6938435b9d8e-plugins-config-volume\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.467391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.467365    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss" pod "bcfdf623-99f3-42ec-94b2-6938435b9d8e" (UID: "bcfdf623-99f3-42ec-94b2-6938435b9d8e"). InnerVolumeSpecName "kube-api-access-fgwss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:06.567238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567204    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567343    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567395    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567535 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567467    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567543    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567609    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567688    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.567775 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567759    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.568091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.567792    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket\") pod \"80e791e1-8d92-4bfe-9865-8a67e8268b49\" (UID: \"80e791e1-8d92-4bfe-9865-8a67e8268b49\") "
Nov 03 21:48:06.568205 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.568177    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:06.569310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.568552    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgwss\" (UniqueName: \"kubernetes.io/projected/bcfdf623-99f3-42ec-94b2-6938435b9d8e-kube-api-access-fgwss\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.569310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.568578    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.569310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.568775    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:06.569310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.568793    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:06.569310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.569243    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:06.569310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.569026    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:06.571270 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.571239    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:06.571377 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.571288    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:06.571888 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.571866    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:06.572072 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.572045    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8" pod "80e791e1-8d92-4bfe-9865-8a67e8268b49" (UID: "80e791e1-8d92-4bfe-9865-8a67e8268b49"). InnerVolumeSpecName "kube-api-access-dnnx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:06.670198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670164    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670194    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670203    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670212    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnnx8\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-kube-api-access-dnnx8\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670225    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80e791e1-8d92-4bfe-9865-8a67e8268b49-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670234    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670242    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80e791e1-8d92-4bfe-9865-8a67e8268b49-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.670446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.670249    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80e791e1-8d92-4bfe-9865-8a67e8268b49-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:06.720066 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.720016    6774 generic.go:356] "Generic (PLEG): container finished" podID="bcfdf623-99f3-42ec-94b2-6938435b9d8e" containerID="dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a" exitCode=0
Nov 03 21:48:06.720222 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.720135    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w" event={"ID":"bcfdf623-99f3-42ec-94b2-6938435b9d8e","Type":"ContainerDied","Data":"dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a"}
Nov 03 21:48:06.720222 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.720145    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"
Nov 03 21:48:06.720222 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.720184    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w" event={"ID":"bcfdf623-99f3-42ec-94b2-6938435b9d8e","Type":"ContainerDied","Data":"5ea7caf59991464893ace397bb9bac4411411bbc99ba4ecb7ab2347129457d89"}
Nov 03 21:48:06.720222 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.720214    6774 scope.go:122] "RemoveContainer" containerID="dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a"
Nov 03 21:48:06.726407 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.726377    6774 generic.go:356] "Generic (PLEG): container finished" podID="9eb2c331-29ef-4cb6-b42a-e20cfed79499" containerID="24d1469613670c82cfda6109de6899fb2cd81b3d7fd23d54837a3dadcd06456f" exitCode=0
Nov 03 21:48:06.726599 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.726558    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc" event={"ID":"9eb2c331-29ef-4cb6-b42a-e20cfed79499","Type":"ContainerDied","Data":"24d1469613670c82cfda6109de6899fb2cd81b3d7fd23d54837a3dadcd06456f"}
Nov 03 21:48:06.728099 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.728080    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"
Nov 03 21:48:06.728260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.728081    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7" event={"ID":"e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e","Type":"ContainerDied","Data":"1261de296a0cd4d07b72ce72d303db7154e505532e3d1212bb8987d87f6a40f1"}
Nov 03 21:48:06.729622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.729599    6774 generic.go:356] "Generic (PLEG): container finished" podID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerID="a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d" exitCode=0
Nov 03 21:48:06.729693 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.729645    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"
Nov 03 21:48:06.729745 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.729687    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" event={"ID":"80e791e1-8d92-4bfe-9865-8a67e8268b49","Type":"ContainerDied","Data":"a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d"}
Nov 03 21:48:06.729745 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.729728    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7" event={"ID":"80e791e1-8d92-4bfe-9865-8a67e8268b49","Type":"ContainerDied","Data":"9ef24fe94196a6aeb375aa88d3ac8ce08eb448871c05f333e5c69433d6f9d4f3"}
Nov 03 21:48:06.738009 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.737989    6774 scope.go:122] "RemoveContainer" containerID="dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a"
Nov 03 21:48:06.738439 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:06.738399    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a\": container with ID starting with dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a not found: ID does not exist" containerID="dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a"
Nov 03 21:48:06.738541 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.738457    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a"} err="failed to get container status \"dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a\": rpc error: code = NotFound desc = could not find container \"dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a\": container with ID starting with dc199950d988eb94876f84dd7694f738eeb057c8856eda24580421933e88322a not found: ID does not exist"
Nov 03 21:48:06.738541 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.738483    6774 scope.go:122] "RemoveContainer" containerID="adecdf77d76eb20a4113b2ce380d940a4fc7f4e841f9e60905715a8234073225"
Nov 03 21:48:06.748793 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.748769    6774 scope.go:122] "RemoveContainer" containerID="a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d"
Nov 03 21:48:06.761504 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.761479    6774 scope.go:122] "RemoveContainer" containerID="a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d"
Nov 03 21:48:06.762094 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:06.762069    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d\": container with ID starting with a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d not found: ID does not exist" containerID="a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d"
Nov 03 21:48:06.762174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.762102    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d"} err="failed to get container status \"a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d\": rpc error: code = NotFound desc = could not find container \"a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d\": container with ID starting with a246814caaae0d5444166d4d3c34a801a4ba4382d6a41c7c4772f60e46cff99d not found: ID does not exist"
Nov 03 21:48:06.832723 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.832689    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"]
Nov 03 21:48:06.835954 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.835928    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-4eced5/simulator-w1-4eced5-kserve-6dfc4cffb8-fx8r7"]
Nov 03 21:48:06.875851 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.875816    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"]
Nov 03 21:48:06.880730 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.880704    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-05bc27-766f96cc88-bt58w"]
Nov 03 21:48:06.914711 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.914682    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"]
Nov 03 21:48:06.919300 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.919278    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-dd5620-openshift-default-86d5bc584f-rhvj7"]
Nov 03 21:48:06.923115 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.923060    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:06.995238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.995200    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"]
Nov 03 21:48:06.996007 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.995984    6774 cpu_manager.go:414] "containerMap: removing container" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996007    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996041    6774 cpu_manager.go:414] "containerMap: removing container" podUID="bcfdf623-99f3-42ec-94b2-6938435b9d8e" containerName="payload-processing"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996049    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bcfdf623-99f3-42ec-94b2-6938435b9d8e" containerName="payload-processing"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996059    6774 cpu_manager.go:414] "containerMap: removing container" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996067    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996078    6774 cpu_manager.go:414] "containerMap: removing container" podUID="310d18ab-d068-4bd1-bb1a-73dab67664f0" containerName="revoke-keys"
Nov 03 21:48:06.996117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996086    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="310d18ab-d068-4bd1-bb1a-73dab67664f0" containerName="revoke-keys"
Nov 03 21:48:06.996482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996213    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="bcfdf623-99f3-42ec-94b2-6938435b9d8e" containerName="payload-processing"
Nov 03 21:48:06.996482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996226    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" containerName="main"
Nov 03 21:48:06.996482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996237    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="310d18ab-d068-4bd1-bb1a-73dab67664f0" containerName="revoke-keys"
Nov 03 21:48:06.996482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:06.996252    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" containerName="istio-proxy"
Nov 03 21:48:07.000148 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.000126    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.021190 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.021162    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"]
Nov 03 21:48:07.075442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.075386    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca\") pod \"310d18ab-d068-4bd1-bb1a-73dab67664f0\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") "
Nov 03 21:48:07.075589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.075556    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk\" (UniqueName: \"kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk\") pod \"310d18ab-d068-4bd1-bb1a-73dab67664f0\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") "
Nov 03 21:48:07.075647 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.075600    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca\") pod \"310d18ab-d068-4bd1-bb1a-73dab67664f0\" (UID: \"310d18ab-d068-4bd1-bb1a-73dab67664f0\") "
Nov 03 21:48:07.075803 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.075781    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca" pod "310d18ab-d068-4bd1-bb1a-73dab67664f0" (UID: "310d18ab-d068-4bd1-bb1a-73dab67664f0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:07.076120 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.076101    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:07.077717 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.077690    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk" pod "310d18ab-d068-4bd1-bb1a-73dab67664f0" (UID: "310d18ab-d068-4bd1-bb1a-73dab67664f0"). InnerVolumeSpecName "kube-api-access-z8mwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:07.077858 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.077752    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca" pod "310d18ab-d068-4bd1-bb1a-73dab67664f0" (UID: "310d18ab-d068-4bd1-bb1a-73dab67664f0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:07.177523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.177412    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.177689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.177569    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.177689 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.177600    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m52k\" (UniqueName: \"kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.177845 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.177822    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8mwk\" (UniqueName: \"kubernetes.io/projected/310d18ab-d068-4bd1-bb1a-73dab67664f0-kube-api-access-z8mwk\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:07.177897 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.177852    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/310d18ab-d068-4bd1-bb1a-73dab67664f0-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:07.279081 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.279042    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.279275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.279120    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.279275 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.279146    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m52k\" (UniqueName: \"kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.279880 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.279853    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.281380 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.281361    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.299475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.299443    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m52k\" (UniqueName: \"kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k\") pod \"maas-api-revoke-sub-bba538ea-cmsnx\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.325068 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.325028    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:07.623635 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:48:07.623593    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a808086_8284_4a58_8292_7af94d6b86fe.slice/crio-8f8d58ff5a535c9f1da72ab6717eb4f5fb8cf021dc770436e79ee3f77beb2dc2 WatchSource:0}: Error finding container 8f8d58ff5a535c9f1da72ab6717eb4f5fb8cf021dc770436e79ee3f77beb2dc2: Status 404 returned error can't find the container with id 8f8d58ff5a535c9f1da72ab6717eb4f5fb8cf021dc770436e79ee3f77beb2dc2
Nov 03 21:48:07.623635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.623618    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"]
Nov 03 21:48:07.738849 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.738814    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx" event={"ID":"4a808086-8284-4a58-8292-7af94d6b86fe","Type":"ContainerStarted","Data":"8f8d58ff5a535c9f1da72ab6717eb4f5fb8cf021dc770436e79ee3f77beb2dc2"}
Nov 03 21:48:07.741293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.741271    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"
Nov 03 21:48:07.741454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.741274    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv" event={"ID":"310d18ab-d068-4bd1-bb1a-73dab67664f0","Type":"ContainerDied","Data":"eec1f271cce89174fae0d6e81e8a08dee724deaa4b576b0672f9f1e2a84e522c"}
Nov 03 21:48:07.741454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.741390    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eec1f271cce89174fae0d6e81e8a08dee724deaa4b576b0672f9f1e2a84e522c"
Nov 03 21:48:07.911094 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:07.911071    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:08.089957 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.089929    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj\" (UniqueName: \"kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj\") pod \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") "
Nov 03 21:48:08.090375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.089988    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca\") pod \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") "
Nov 03 21:48:08.090375 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.090035    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca\") pod \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\" (UID: \"9eb2c331-29ef-4cb6-b42a-e20cfed79499\") "
Nov 03 21:48:08.090559 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.090517    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca" pod "9eb2c331-29ef-4cb6-b42a-e20cfed79499" (UID: "9eb2c331-29ef-4cb6-b42a-e20cfed79499"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:08.092132 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.092112    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca" pod "9eb2c331-29ef-4cb6-b42a-e20cfed79499" (UID: "9eb2c331-29ef-4cb6-b42a-e20cfed79499"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:08.092268 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.092249    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj" pod "9eb2c331-29ef-4cb6-b42a-e20cfed79499" (UID: "9eb2c331-29ef-4cb6-b42a-e20cfed79499"). InnerVolumeSpecName "kube-api-access-z2prj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:08.159258 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.159139    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80e791e1-8d92-4bfe-9865-8a67e8268b49" path="/var/lib/kubelet/pods/80e791e1-8d92-4bfe-9865-8a67e8268b49/volumes"
Nov 03 21:48:08.159599 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.159585    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bcfdf623-99f3-42ec-94b2-6938435b9d8e" path="/var/lib/kubelet/pods/bcfdf623-99f3-42ec-94b2-6938435b9d8e/volumes"
Nov 03 21:48:08.159983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.159970    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e" path="/var/lib/kubelet/pods/e479bcc7-fbcb-47d2-941a-f60f5bf3aa1e/volumes"
Nov 03 21:48:08.192325 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.192293    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2prj\" (UniqueName: \"kubernetes.io/projected/9eb2c331-29ef-4cb6-b42a-e20cfed79499-kube-api-access-z2prj\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:08.192325 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.192324    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:08.192514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.192338    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9eb2c331-29ef-4cb6-b42a-e20cfed79499-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:08.750018 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.749981    6774 generic.go:356] "Generic (PLEG): container finished" podID="4a808086-8284-4a58-8292-7af94d6b86fe" containerID="75390f443ffd554dd7b3071e0961a38083dc6848eb9d67022fb67de66c4273fe" exitCode=0
Nov 03 21:48:08.750174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.750037    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx" event={"ID":"4a808086-8284-4a58-8292-7af94d6b86fe","Type":"ContainerDied","Data":"75390f443ffd554dd7b3071e0961a38083dc6848eb9d67022fb67de66c4273fe"}
Nov 03 21:48:08.751408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.751387    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"
Nov 03 21:48:08.751408 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.751394    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc" event={"ID":"9eb2c331-29ef-4cb6-b42a-e20cfed79499","Type":"ContainerDied","Data":"1a6a79f26f6f7663fc318774502f38de5d6e36da160e9a176f075d1840b4f680"}
Nov 03 21:48:08.751589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.751444    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a6a79f26f6f7663fc318774502f38de5d6e36da160e9a176f075d1840b4f680"
Nov 03 21:48:08.972810 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.972725    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main" containerID="cri-o://8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a" gracePeriod=45
Nov 03 21:48:08.984727 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:08.984686    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main" containerID="cri-o://c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41" gracePeriod=45
Nov 03 21:48:09.295119 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.295092    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:48:09.299263 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.299232    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:48:09.409165 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409124    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5\" (UniqueName: \"kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5\") pod \"82f65cc7-1290-4293-ae7f-f0f9965c4743\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") "
Nov 03 21:48:09.409345 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409216    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir\") pod \"82f65cc7-1290-4293-ae7f-f0f9965c4743\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") "
Nov 03 21:48:09.409345 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409245    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw\" (UniqueName: \"kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw\") pod \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") "
Nov 03 21:48:09.409624 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409601    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home\") pod \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") "
Nov 03 21:48:09.409624 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409600    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir" pod "82f65cc7-1290-4293-ae7f-f0f9965c4743" (UID: "82f65cc7-1290-4293-ae7f-f0f9965c4743"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.409752 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409657    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm\") pod \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") "
Nov 03 21:48:09.409793 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409779    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir\") pod \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") "
Nov 03 21:48:09.409855 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409823    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache\") pod \"82f65cc7-1290-4293-ae7f-f0f9965c4743\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") "
Nov 03 21:48:09.409914 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409855    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs\" (UniqueName: \"kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs\") pod \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") "
Nov 03 21:48:09.409914 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409867    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home" pod "b937cb50-ba91-42b3-9a0d-acdb7bf12e87" (UID: "b937cb50-ba91-42b3-9a0d-acdb7bf12e87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.409914 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409910    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home\") pod \"82f65cc7-1290-4293-ae7f-f0f9965c4743\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") "
Nov 03 21:48:09.410058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.409971    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm\") pod \"82f65cc7-1290-4293-ae7f-f0f9965c4743\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") "
Nov 03 21:48:09.410058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.410008    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs\" (UniqueName: \"kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs\") pod \"82f65cc7-1290-4293-ae7f-f0f9965c4743\" (UID: \"82f65cc7-1290-4293-ae7f-f0f9965c4743\") "
Nov 03 21:48:09.410058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.410043    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache\") pod \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\" (UID: \"b937cb50-ba91-42b3-9a0d-acdb7bf12e87\") "
Nov 03 21:48:09.410230 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.410059    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir" pod "b937cb50-ba91-42b3-9a0d-acdb7bf12e87" (UID: "b937cb50-ba91-42b3-9a0d-acdb7bf12e87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.410289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.410257    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache" pod "b937cb50-ba91-42b3-9a0d-acdb7bf12e87" (UID: "b937cb50-ba91-42b3-9a0d-acdb7bf12e87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.410356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.410330    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home" pod "82f65cc7-1290-4293-ae7f-f0f9965c4743" (UID: "82f65cc7-1290-4293-ae7f-f0f9965c4743"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.410414 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.410344    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache" pod "82f65cc7-1290-4293-ae7f-f0f9965c4743" (UID: "82f65cc7-1290-4293-ae7f-f0f9965c4743"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.411250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.411226    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.411358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.411252    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.411358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.411283    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.411358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.411297    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.411358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.411309    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.411358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.411321    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.412964 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.412913    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm" pod "82f65cc7-1290-4293-ae7f-f0f9965c4743" (UID: "82f65cc7-1290-4293-ae7f-f0f9965c4743"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.413227 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.413201    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs" pod "82f65cc7-1290-4293-ae7f-f0f9965c4743" (UID: "82f65cc7-1290-4293-ae7f-f0f9965c4743"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:09.413309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.413256    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw" pod "b937cb50-ba91-42b3-9a0d-acdb7bf12e87" (UID: "b937cb50-ba91-42b3-9a0d-acdb7bf12e87"). InnerVolumeSpecName "kube-api-access-ghlrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:09.413831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.413811    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs" pod "b937cb50-ba91-42b3-9a0d-acdb7bf12e87" (UID: "b937cb50-ba91-42b3-9a0d-acdb7bf12e87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:09.413939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.413923    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm" pod "b937cb50-ba91-42b3-9a0d-acdb7bf12e87" (UID: "b937cb50-ba91-42b3-9a0d-acdb7bf12e87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:09.414119 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.414104    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5" pod "82f65cc7-1290-4293-ae7f-f0f9965c4743" (UID: "82f65cc7-1290-4293-ae7f-f0f9965c4743"). InnerVolumeSpecName "kube-api-access-2ghd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:09.512273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.512190    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghlrw\" (UniqueName: \"kubernetes.io/projected/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-kube-api-access-ghlrw\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.512273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.512223    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.512273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.512237    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b937cb50-ba91-42b3-9a0d-acdb7bf12e87-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.512273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.512251    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82f65cc7-1290-4293-ae7f-f0f9965c4743-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.512273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.512262    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82f65cc7-1290-4293-ae7f-f0f9965c4743-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.512273 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.512274    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ghd5\" (UniqueName: \"kubernetes.io/projected/82f65cc7-1290-4293-ae7f-f0f9965c4743-kube-api-access-2ghd5\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:09.759816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.759782    6774 generic.go:356] "Generic (PLEG): container finished" podID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerID="c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41" exitCode=0
Nov 03 21:48:09.759975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.759831    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"
Nov 03 21:48:09.759975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.759876    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" event={"ID":"82f65cc7-1290-4293-ae7f-f0f9965c4743","Type":"ContainerDied","Data":"c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41"}
Nov 03 21:48:09.759975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.759928    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65" event={"ID":"82f65cc7-1290-4293-ae7f-f0f9965c4743","Type":"ContainerDied","Data":"7fce063a1fdf9ce4ab621ca1017d378d50c5bc633ccc42d93e2a7fb0291b519e"}
Nov 03 21:48:09.759975 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.759952    6774 scope.go:122] "RemoveContainer" containerID="c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41"
Nov 03 21:48:09.761570 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.761542    6774 generic.go:356] "Generic (PLEG): container finished" podID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerID="8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a" exitCode=0
Nov 03 21:48:09.761731 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.761580    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"
Nov 03 21:48:09.761731 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.761645    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" event={"ID":"b937cb50-ba91-42b3-9a0d-acdb7bf12e87","Type":"ContainerDied","Data":"8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a"}
Nov 03 21:48:09.761731 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.761700    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f" event={"ID":"b937cb50-ba91-42b3-9a0d-acdb7bf12e87","Type":"ContainerDied","Data":"f52f7235e5700f36d5e8fd1b995697b59a7cb513d792991c9bf65c4fa518f7bf"}
Nov 03 21:48:09.772289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.771966    6774 scope.go:122] "RemoveContainer" containerID="c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41"
Nov 03 21:48:09.772379 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:09.772355    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41\": container with ID starting with c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41 not found: ID does not exist" containerID="c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41"
Nov 03 21:48:09.772417 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.772390    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41"} err="failed to get container status \"c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41\": rpc error: code = NotFound desc = could not find container \"c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41\": container with ID starting with c18da60373e29738866ce1432f26ac8389099535699d90dab9f217559c110f41 not found: ID does not exist"
Nov 03 21:48:09.772417 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.772414    6774 scope.go:122] "RemoveContainer" containerID="8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a"
Nov 03 21:48:09.782991 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.782973    6774 scope.go:122] "RemoveContainer" containerID="8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a"
Nov 03 21:48:09.783276 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:09.783257    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a\": container with ID starting with 8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a not found: ID does not exist" containerID="8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a"
Nov 03 21:48:09.783323 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.783284    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a"} err="failed to get container status \"8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a\": rpc error: code = NotFound desc = could not find container \"8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a\": container with ID starting with 8c380139553a51145aef40b2a0d2599ba92366bcebfa5f357097fd2df857368a not found: ID does not exist"
Nov 03 21:48:09.814160 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.814126    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"]
Nov 03 21:48:09.817982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.817957    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/premium-w4-05bc27-kserve-7795444667-crv8f"]
Nov 03 21:48:09.859466 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.859414    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"]
Nov 03 21:48:09.862296 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.862270    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-05bc27/simulator-w4-05bc27-kserve-56874bfb94-mgj65"]
Nov 03 21:48:09.924095 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:09.924069    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:10.018200 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.018118    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca\") pod \"4a808086-8284-4a58-8292-7af94d6b86fe\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") "
Nov 03 21:48:10.018200 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.018160    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k\" (UniqueName: \"kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k\") pod \"4a808086-8284-4a58-8292-7af94d6b86fe\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") "
Nov 03 21:48:10.018384 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.018327    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca\") pod \"4a808086-8284-4a58-8292-7af94d6b86fe\" (UID: \"4a808086-8284-4a58-8292-7af94d6b86fe\") "
Nov 03 21:48:10.018606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.018579    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca" pod "4a808086-8284-4a58-8292-7af94d6b86fe" (UID: "4a808086-8284-4a58-8292-7af94d6b86fe"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:10.020332 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.020310    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca" pod "4a808086-8284-4a58-8292-7af94d6b86fe" (UID: "4a808086-8284-4a58-8292-7af94d6b86fe"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:10.020332 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.020316    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k" pod "4a808086-8284-4a58-8292-7af94d6b86fe" (UID: "4a808086-8284-4a58-8292-7af94d6b86fe"). InnerVolumeSpecName "kube-api-access-9m52k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:10.120376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.120344    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:10.120376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.120372    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4a808086-8284-4a58-8292-7af94d6b86fe-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:10.120376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.120381    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m52k\" (UniqueName: \"kubernetes.io/projected/4a808086-8284-4a58-8292-7af94d6b86fe-kube-api-access-9m52k\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:10.160076 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.160045    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" path="/var/lib/kubelet/pods/82f65cc7-1290-4293-ae7f-f0f9965c4743/volumes"
Nov 03 21:48:10.160521 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.160505    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" path="/var/lib/kubelet/pods/b937cb50-ba91-42b3-9a0d-acdb7bf12e87/volumes"
Nov 03 21:48:10.770502 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.770475    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"
Nov 03 21:48:10.771086 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.770472    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx" event={"ID":"4a808086-8284-4a58-8292-7af94d6b86fe","Type":"ContainerDied","Data":"8f8d58ff5a535c9f1da72ab6717eb4f5fb8cf021dc770436e79ee3f77beb2dc2"}
Nov 03 21:48:10.771086 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:10.770639    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f8d58ff5a535c9f1da72ab6717eb4f5fb8cf021dc770436e79ee3f77beb2dc2"
Nov 03 21:48:12.376531 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:12.376495    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:48:19.660282 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.660256    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:48:19.777149 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.777064    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4\" (UniqueName: \"kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4\") pod \"50ec3eb8-fcda-4d89-9c74-2957364cc013\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") "
Nov 03 21:48:19.777310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.777224    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume\") pod \"50ec3eb8-fcda-4d89-9c74-2957364cc013\" (UID: \"50ec3eb8-fcda-4d89-9c74-2957364cc013\") "
Nov 03 21:48:19.777684 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.777657    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume" pod "50ec3eb8-fcda-4d89-9c74-2957364cc013" (UID: "50ec3eb8-fcda-4d89-9c74-2957364cc013"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:19.777813 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.777798    6774 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50ec3eb8-fcda-4d89-9c74-2957364cc013-plugins-config-volume\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:19.779165 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.779142    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4" pod "50ec3eb8-fcda-4d89-9c74-2957364cc013" (UID: "50ec3eb8-fcda-4d89-9c74-2957364cc013"). InnerVolumeSpecName "kube-api-access-mgbc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:19.846217 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.846181    6774 generic.go:356] "Generic (PLEG): container finished" podID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerID="a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc" exitCode=0
Nov 03 21:48:19.846392 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.846228    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"
Nov 03 21:48:19.846392 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.846268    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" event={"ID":"50ec3eb8-fcda-4d89-9c74-2957364cc013","Type":"ContainerDied","Data":"a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc"}
Nov 03 21:48:19.846392 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.846349    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv" event={"ID":"50ec3eb8-fcda-4d89-9c74-2957364cc013","Type":"ContainerDied","Data":"1aa1a8043aa08293131f8bb0113e28b5b406677efa91856dbc0df7dc1d9d19fb"}
Nov 03 21:48:19.846392 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.846375    6774 scope.go:122] "RemoveContainer" containerID="a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc"
Nov 03 21:48:19.856401 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.856379    6774 scope.go:122] "RemoveContainer" containerID="a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc"
Nov 03 21:48:19.856786 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:19.856757    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc\": container with ID starting with a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc not found: ID does not exist" containerID="a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc"
Nov 03 21:48:19.856943 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.856906    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc"} err="failed to get container status \"a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc\": rpc error: code = NotFound desc = could not find container \"a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc\": container with ID starting with a99e6f7e65d6e44b408ed7ff0c573fea37c4037b1784cddd9364c51dcce2c0bc not found: ID does not exist"
Nov 03 21:48:19.878920 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.878893    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgbc4\" (UniqueName: \"kubernetes.io/projected/50ec3eb8-fcda-4d89-9c74-2957364cc013-kube-api-access-mgbc4\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:19.920722 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.920681    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"]
Nov 03 21:48:19.930593 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:19.930565    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w5-0a6da1-7bb548958c-ch9wv"]
Nov 03 21:48:20.159449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:20.159399    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" path="/var/lib/kubelet/pods/50ec3eb8-fcda-4d89-9c74-2957364cc013/volumes"
Nov 03 21:48:21.073151 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.073115    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"]
Nov 03 21:48:21.073762 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.073395    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" podUID="942ede37-4531-4b77-b085-f792cfc7bb37" containerName="maas-api" containerID="cri-o://c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53" gracePeriod=30
Nov 03 21:48:21.307437 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.307376    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main" containerID="cri-o://8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e" gracePeriod=45
Nov 03 21:48:21.661943 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.661915    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:48:21.806693 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806656    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache\") pod \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") "
Nov 03 21:48:21.806863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806737    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7\" (UniqueName: \"kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7\") pod \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") "
Nov 03 21:48:21.806863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806785    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm\") pod \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") "
Nov 03 21:48:21.806863 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806830    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home\") pod \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") "
Nov 03 21:48:21.807047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806865    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir\") pod \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") "
Nov 03 21:48:21.807047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806968    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs\") pod \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\" (UID: \"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5\") "
Nov 03 21:48:21.807047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.806985    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache" pod "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" (UID: "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:21.807235 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.807197    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home" pod "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" (UID: "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:21.807297 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.807230    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir" pod "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" (UID: "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:21.807606 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.807587    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:21.807691 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.807609    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:21.807691 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.807622    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:21.809079 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.809054    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm" pod "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" (UID: "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:21.809373 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.809348    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs" pod "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" (UID: "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:21.809373 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.809370    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7" pod "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" (UID: "b69f395a-e6fe-4f1f-b8c9-9f95a00923d5"). InnerVolumeSpecName "kube-api-access-gz5c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:21.863184 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.863146    6774 generic.go:356] "Generic (PLEG): container finished" podID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerID="8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e" exitCode=0
Nov 03 21:48:21.863346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.863190    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"
Nov 03 21:48:21.863346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.863205    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" event={"ID":"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5","Type":"ContainerDied","Data":"8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e"}
Nov 03 21:48:21.863346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.863242    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t" event={"ID":"b69f395a-e6fe-4f1f-b8c9-9f95a00923d5","Type":"ContainerDied","Data":"e28b9dd0109dd4732f28026e6d5368320bbf7bf5c01916f863af736489cb24e8"}
Nov 03 21:48:21.863346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.863261    6774 scope.go:122] "RemoveContainer" containerID="8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e"
Nov 03 21:48:21.878790 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.878761    6774 scope.go:122] "RemoveContainer" containerID="8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e"
Nov 03 21:48:21.879171 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:21.879149    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e\": container with ID starting with 8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e not found: ID does not exist" containerID="8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e"
Nov 03 21:48:21.879303 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.879185    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e"} err="failed to get container status \"8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e\": rpc error: code = NotFound desc = could not find container \"8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e\": container with ID starting with 8128f6e83596771350ab40b0ee1ef23d4a5c81d6fb8e88b63bb565a6e2b5d77e not found: ID does not exist"
Nov 03 21:48:21.909706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.909625    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz5c7\" (UniqueName: \"kubernetes.io/projected/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-kube-api-access-gz5c7\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:21.909706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.909662    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:21.909706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.909678    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:21.927088 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.927062    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"]
Nov 03 21:48:21.929603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:21.929577    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-27fdf4/simulator-w2-27fdf4-kserve-bd496665b-7p82t"]
Nov 03 21:48:22.159043 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.159006    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" path="/var/lib/kubelet/pods/b69f395a-e6fe-4f1f-b8c9-9f95a00923d5/volumes"
Nov 03 21:48:22.365218 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.365189    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:48:22.379247 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.379216    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"]
Nov 03 21:48:22.383716 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.383681    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-e246f9-c7dvc"]
Nov 03 21:48:22.516827 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.516751    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca\") pod \"942ede37-4531-4b77-b085-f792cfc7bb37\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") "
Nov 03 21:48:22.516973 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.516848    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\") pod \"942ede37-4531-4b77-b085-f792cfc7bb37\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") "
Nov 03 21:48:22.516973 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.516891    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4\" (UniqueName: \"kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4\") pod \"942ede37-4531-4b77-b085-f792cfc7bb37\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") "
Nov 03 21:48:22.516973 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.516917    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs\") pod \"942ede37-4531-4b77-b085-f792cfc7bb37\" (UID: \"942ede37-4531-4b77-b085-f792cfc7bb37\") "
Nov 03 21:48:22.517163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.517135    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca" pod "942ede37-4531-4b77-b085-f792cfc7bb37" (UID: "942ede37-4531-4b77-b085-f792cfc7bb37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:22.517470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.517448    6774 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/942ede37-4531-4b77-b085-f792cfc7bb37-openshift-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:22.519277 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.519237    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls" pod "942ede37-4531-4b77-b085-f792cfc7bb37" (UID: "942ede37-4531-4b77-b085-f792cfc7bb37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:22.522317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.522271    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs" pod "942ede37-4531-4b77-b085-f792cfc7bb37" (UID: "942ede37-4531-4b77-b085-f792cfc7bb37"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:22.522573 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.522549    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4" pod "942ede37-4531-4b77-b085-f792cfc7bb37" (UID: "942ede37-4531-4b77-b085-f792cfc7bb37"). InnerVolumeSpecName "kube-api-access-nrvc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:22.618998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.618963    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-maas-api-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:22.618998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.618995    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrvc4\" (UniqueName: \"kubernetes.io/projected/942ede37-4531-4b77-b085-f792cfc7bb37-kube-api-access-nrvc4\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:22.618998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.619006    6774 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/942ede37-4531-4b77-b085-f792cfc7bb37-metrics-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:22.875001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.874957    6774 generic.go:356] "Generic (PLEG): container finished" podID="942ede37-4531-4b77-b085-f792cfc7bb37" containerID="c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53" exitCode=0
Nov 03 21:48:22.875396 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.875371    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" event={"ID":"942ede37-4531-4b77-b085-f792cfc7bb37","Type":"ContainerDied","Data":"c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53"}
Nov 03 21:48:22.875615 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.875598    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r" event={"ID":"942ede37-4531-4b77-b085-f792cfc7bb37","Type":"ContainerDied","Data":"fa5ba9a85da3eea0e336eac3ae2f8b18bded07f8deab485c18f9e9db6fe3f155"}
Nov 03 21:48:22.875743 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.875730    6774 scope.go:122] "RemoveContainer" containerID="c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53"
Nov 03 21:48:22.876021 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.876004    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"
Nov 03 21:48:22.886668 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.886649    6774 scope.go:122] "RemoveContainer" containerID="c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53"
Nov 03 21:48:22.886974 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:22.886952    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53\": container with ID starting with c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53 not found: ID does not exist" containerID="c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53"
Nov 03 21:48:22.887021 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.886981    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53"} err="failed to get container status \"c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53\": rpc error: code = NotFound desc = could not find container \"c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53\": container with ID starting with c71175f5d1e9eae332f07e6f7e6cb37613f13bb25b9050a6db7d1dff51d3db53 not found: ID does not exist"
Nov 03 21:48:22.931557 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.931523    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"]
Nov 03 21:48:22.944732 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:22.944699    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e246f9-d64d94985-mkn7r"]
Nov 03 21:48:24.159214 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:24.159182    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="942ede37-4531-4b77-b085-f792cfc7bb37" path="/var/lib/kubelet/pods/942ede37-4531-4b77-b085-f792cfc7bb37/volumes"
Nov 03 21:48:24.159684 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:24.159669    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1e496cc-6db2-4eb1-959b-ea8461d4936c" path="/var/lib/kubelet/pods/b1e496cc-6db2-4eb1-959b-ea8461d4936c/volumes"
Nov 03 21:48:25.760809 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.760778    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"]
Nov 03 21:48:25.761318 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761303    6774 cpu_manager.go:414] "containerMap: removing container" podUID="942ede37-4531-4b77-b085-f792cfc7bb37" containerName="maas-api"
Nov 03 21:48:25.761358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761319    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="942ede37-4531-4b77-b085-f792cfc7bb37" containerName="maas-api"
Nov 03 21:48:25.761358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761330    6774 cpu_manager.go:414] "containerMap: removing container" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main"
Nov 03 21:48:25.761358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761335    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main"
Nov 03 21:48:25.761358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761348    6774 cpu_manager.go:414] "containerMap: removing container" podUID="4a808086-8284-4a58-8292-7af94d6b86fe" containerName="revoke-keys"
Nov 03 21:48:25.761358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761353    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a808086-8284-4a58-8292-7af94d6b86fe" containerName="revoke-keys"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761375    6774 cpu_manager.go:414] "containerMap: removing container" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761381    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761389    6774 cpu_manager.go:414] "containerMap: removing container" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761393    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761409    6774 cpu_manager.go:414] "containerMap: removing container" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerName="payload-pre-processing"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761413    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerName="payload-pre-processing"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761453    6774 cpu_manager.go:414] "containerMap: removing container" podUID="9eb2c331-29ef-4cb6-b42a-e20cfed79499" containerName="revoke-keys"
Nov 03 21:48:25.761529 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761462    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb2c331-29ef-4cb6-b42a-e20cfed79499" containerName="revoke-keys"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761541    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb2c331-29ef-4cb6-b42a-e20cfed79499" containerName="revoke-keys"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761552    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="82f65cc7-1290-4293-ae7f-f0f9965c4743" containerName="main"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761567    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="942ede37-4531-4b77-b085-f792cfc7bb37" containerName="maas-api"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761575    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="b69f395a-e6fe-4f1f-b8c9-9f95a00923d5" containerName="main"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761582    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="b937cb50-ba91-42b3-9a0d-acdb7bf12e87" containerName="main"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761589    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a808086-8284-4a58-8292-7af94d6b86fe" containerName="revoke-keys"
Nov 03 21:48:25.761756 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.761595    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="50ec3eb8-fcda-4d89-9c74-2957364cc013" containerName="payload-pre-processing"
Nov 03 21:48:25.766260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.766241    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.790053 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.789192    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"]
Nov 03 21:48:25.860759 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.860718    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.860942 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.860809    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.860942 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.860863    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.861061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.861001    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.861162 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.861146    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.861250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.861236    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv57q\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.861328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.861316    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.861475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.861417    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.861613 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.861521    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.911952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.911913    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"]
Nov 03 21:48:25.916832 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.916799    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:25.942522 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.942486    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"]
Nov 03 21:48:25.962873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.962829    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963053 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.962994    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963053 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963043    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv57q\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963122    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963182 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963156    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963182    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963206    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963293 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963271    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963458 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963320    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963802 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963773    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.963899 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.963786    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.965003 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.964976    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.965620 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.965598    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.969798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.969766    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.971558 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.971535    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.976753 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.976725    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.983893 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.983867    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:25.984604 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:25.984580    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv57q\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q\") pod \"e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") " pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:26.064183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064085    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064135    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064154    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064179    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064220    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064244    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064276    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064321    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.064469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.064411    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8ncg\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.085347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.085315    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172511    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172665    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8ncg\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172752    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172779    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172809    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172846    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172911    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172949    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.172993    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.173852    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.173930    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.175439    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.176096 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.176044    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.177146 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.177100    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.190413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.189323    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.190413 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.189923    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.195012 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.194986    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.195117 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.195018    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8ncg\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg\") pod \"e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") " pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.245250 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.245213    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:26.441051 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.441017    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"]
Nov 03 21:48:26.441581 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.441367    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy" containerID="cri-o://4a20fe365df496aa03d44f2ec82828a220af80fe866ac40de6e76fbeacb4aea0" gracePeriod=30
Nov 03 21:48:26.460443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.459968    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"]
Nov 03 21:48:26.460443 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.460228    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy" containerID="cri-o://256c4ce508b9686fc98ad3fd047e8783e67b16c388c3702523d4b6d276414477" gracePeriod=30
Nov 03 21:48:26.488676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.487494    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"]
Nov 03 21:48:26.488676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.487740    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy" containerID="cri-o://9ae5e3e2d023be0f04d7e29b6680ae43edbb146cbf50a97061a731cfaf0d432d" gracePeriod=30
Nov 03 21:48:26.565912 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.565874    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"]
Nov 03 21:48:26.583333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.580758    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:48:26.583333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.580850    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:48:26.583333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.580890    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:48:26.793067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.781257    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"]
Nov 03 21:48:26.803452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.795815    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:48:26.803452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.795911    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:48:26.803452 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.795959    6774 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236080Ki","pods":"250"}
Nov 03 21:48:26.934630 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.934576    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" event={"ID":"fda5afff-05fd-4ed1-92cc-529edb057553","Type":"ContainerStarted","Data":"6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418"}
Nov 03 21:48:26.934922 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.934881    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" event={"ID":"fda5afff-05fd-4ed1-92cc-529edb057553","Type":"ContainerStarted","Data":"c95e1e9deac1ca8e50108c2f06a4bbb60e365e8f0b52241a0d9e5c2a6be2407b"}
Nov 03 21:48:26.937842 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.937818    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" event={"ID":"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8","Type":"ContainerStarted","Data":"dde237c508e0cf6f9eec2b6e20ae916009933a40f87e15f3004e689e8838eba2"}
Nov 03 21:48:26.985258 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:26.984535    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podStartSLOduration=1.984515961 podStartE2EDuration="1.984515961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:48:26.981186072 +0000 UTC m=+1076.948022807" watchObservedRunningTime="2026-11-03 21:48:26.984515961 +0000 UTC m=+1076.951352696"
Nov 03 21:48:27.085489 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:27.085458    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:27.086907 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:27.086885    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:27.086990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:27.086930    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:27.960213 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:27.960175    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" event={"ID":"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8","Type":"ContainerStarted","Data":"64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa"}
Nov 03 21:48:28.086445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:28.086155    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:28.086445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:28.086216    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:28.249090 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:28.248991    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:28.249400 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:28.249378    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 21:48:28.249585 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:28.249553    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 21:48:29.102001 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:29.101963    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:29.112565 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:29.112516    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:29.287560 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:29.251854    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 21:48:29.302475 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:29.300562    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 21:48:30.085924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.085888    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:30.086244 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.086198    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:30.252449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.250540    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 21:48:30.252449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.250604    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 21:48:30.580140 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.580063    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" podStartSLOduration=5.580039553 podStartE2EDuration="5.580039553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:48:28.032960824 +0000 UTC m=+1077.999797557" watchObservedRunningTime="2026-11-03 21:48:30.580039553 +0000 UTC m=+1080.546876289"
Nov 03 21:48:30.612560 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.589626    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"]
Nov 03 21:48:30.735455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.698021    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"]
Nov 03 21:48:30.908853 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:30.908795    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" containerID="cri-o://5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c" gracePeriod=30
Nov 03 21:48:31.092521 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.086395    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:31.092838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.092799    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:31.312499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.296576    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Nov 03 21:48:31.312499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.296668    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Nov 03 21:48:31.312499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.297377    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"]
Nov 03 21:48:31.312499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.297633    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" containerID="cri-o://23f2a60dad10410f8fd891b8be135ab542e5a29d056351152e4f44b77761065b" gracePeriod=30
Nov 03 21:48:31.404767 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.404722    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy" containerID="cri-o://64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa" gracePeriod=30
Nov 03 21:48:31.445932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.445902    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"]
Nov 03 21:48:31.446397 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.446365    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" containerID="cri-o://d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885" gracePeriod=30
Nov 03 21:48:31.505921 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.502562    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"]
Nov 03 21:48:31.506386 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.506347    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" containerID="cri-o://cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa" gracePeriod=30
Nov 03 21:48:31.721870 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:31.719172    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:48:31.721870 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.719509    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:48:31.755873 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:31.755807    6774 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:48:32.092566 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:32.092535    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:32.092811 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:32.092781    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:32.862330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:32.860613    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:48:32.862330 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:32.861053    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:48:33.065692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.059901    6774 generic.go:356] "Generic (PLEG): container finished" podID="9adaa258-956e-426e-8912-fae770dfc3d8" containerID="256c4ce508b9686fc98ad3fd047e8783e67b16c388c3702523d4b6d276414477" exitCode=0
Nov 03 21:48:33.065692 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.060132    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" event={"ID":"9adaa258-956e-426e-8912-fae770dfc3d8","Type":"ContainerDied","Data":"256c4ce508b9686fc98ad3fd047e8783e67b16c388c3702523d4b6d276414477"}
Nov 03 21:48:33.081716 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.070648    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:48:33.137473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.136654    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:48:33.155514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.155478    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:33.187827 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.187610    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:33.191525 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.186240    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.191808 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.191788    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.212680 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.212650    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.213280 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.213259    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.213801 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.213783    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.213959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.213940    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.214139 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214123    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.214253 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214238    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.214353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214338    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.214469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214454    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.214589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214575    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.214706 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214693    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.214853 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214841    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.214957 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.214945    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.215056 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.215044    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.215206 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.215194    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.215368 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.215355    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy\") pod \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\" (UID: \"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c\") "
Nov 03 21:48:33.215510 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.215494    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb\") pod \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\" (UID: \"703634ce-d518-4b85-a5bb-31e1ac3aa8a9\") "
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.241037    6774 generic.go:356] "Generic (PLEG): container finished" podID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerID="9ae5e3e2d023be0f04d7e29b6680ae43edbb146cbf50a97061a731cfaf0d432d" exitCode=0
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.241319    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" event={"ID":"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c","Type":"ContainerDied","Data":"9ae5e3e2d023be0f04d7e29b6680ae43edbb146cbf50a97061a731cfaf0d432d"}
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.241383    6774 scope.go:122] "RemoveContainer" containerID="9ae5e3e2d023be0f04d7e29b6680ae43edbb146cbf50a97061a731cfaf0d432d"
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.212530    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.246675    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.265672    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:33.279450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.265984    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.289448 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.289395    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.330598 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.289658    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:33.330598 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.297500    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.330598 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.297708    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.330598 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.297883    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335059    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335093    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335110    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335125    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335139    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335152    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335166    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335179    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335193    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.350934 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.335527    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.378667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.377215    6774 generic.go:356] "Generic (PLEG): container finished" podID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerID="4a20fe365df496aa03d44f2ec82828a220af80fe866ac40de6e76fbeacb4aea0" exitCode=0
Nov 03 21:48:33.378667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.377330    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s" event={"ID":"703634ce-d518-4b85-a5bb-31e1ac3aa8a9","Type":"ContainerDied","Data":"4a20fe365df496aa03d44f2ec82828a220af80fe866ac40de6e76fbeacb4aea0"}
Nov 03 21:48:33.378667 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.377523    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"
Nov 03 21:48:33.426656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.416819    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:48:33.456733 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.456630    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.539608 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.539542    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.539998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.539955    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "kube-api-access-nf5q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:33.545457 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.540254    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:33.545457 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.540568    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:33.545457 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.543560    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.550873    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "kube-api-access-vjtfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.563906    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.563966    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564093    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564188    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564221    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564263    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564302    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564415    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564519    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket\") pod \"9adaa258-956e-426e-8912-fae770dfc3d8\" (UID: \"9adaa258-956e-426e-8912-fae770dfc3d8\") "
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.564960    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.565319    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.565593    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.568833    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569638    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569664    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9adaa258-956e-426e-8912-fae770dfc3d8-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569681    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjtfb\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-kube-api-access-vjtfb\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569695    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569710    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569724    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf5q9\" (UniqueName: \"kubernetes.io/projected/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-kube-api-access-nf5q9\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569738    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569752    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569768    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569781    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.573459 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.569931    6774 scope.go:122] "RemoveContainer" containerID="4a20fe365df496aa03d44f2ec82828a220af80fe866ac40de6e76fbeacb4aea0"
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.576444    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.580151    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.581085    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.581134    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.584467    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy" pod "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" (UID: "04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.584642    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token" pod "703634ce-d518-4b85-a5bb-31e1ac3aa8a9" (UID: "703634ce-d518-4b85-a5bb-31e1ac3aa8a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:33.604470 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.586861    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:33.695548 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.694236    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.695548 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.694277    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.695548 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.694291    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/703634ce-d518-4b85-a5bb-31e1ac3aa8a9-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.695548 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.694304    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.718349 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.718073    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:33.719561 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.719503    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:33.719968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.719922    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9" pod "9adaa258-956e-426e-8912-fae770dfc3d8" (UID: "9adaa258-956e-426e-8912-fae770dfc3d8"). InnerVolumeSpecName "kube-api-access-kdzq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:33.811580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.808923    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9adaa258-956e-426e-8912-fae770dfc3d8-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.811580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.808963    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdzq9\" (UniqueName: \"kubernetes.io/projected/9adaa258-956e-426e-8912-fae770dfc3d8-kube-api-access-kdzq9\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.811580 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.808979    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9adaa258-956e-426e-8912-fae770dfc3d8-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:33.834369 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.834332    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"]
Nov 03 21:48:33.908551 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:33.878455    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-p5p8s"]
Nov 03 21:48:34.088007 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.087929    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused" start-of-body=
Nov 03 21:48:34.088513 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.087980    6774 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.85:15021/healthz/ready\": dial tcp 10.134.0.85:15021: connect: connection refused"
Nov 03 21:48:34.197170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.196314    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" path="/var/lib/kubelet/pods/703634ce-d518-4b85-a5bb-31e1ac3aa8a9/volumes"
Nov 03 21:48:34.327087 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.326054    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"]
Nov 03 21:48:34.327087 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.326710    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" containerID="cri-o://0272d16d5841432d9843154030d363faa611f5e5ae96d2a64a51eab2667ad9d8" gracePeriod=30
Nov 03 21:48:34.333907 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.333329    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"]
Nov 03 21:48:34.333907 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.333643    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy" containerID="cri-o://6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418" gracePeriod=30
Nov 03 21:48:34.334603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.334577    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"]
Nov 03 21:48:34.334786 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.334755    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy" containerID="cri-o://267192e2cd3eca58d0ffca623b8d0642dd0c8b032876a8fe5ea041eb96f12e3a" gracePeriod=30
Nov 03 21:48:34.414891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.414802    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv" event={"ID":"04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c","Type":"ContainerDied","Data":"d116e7648d17c538303bd905c924caef0fd5624679b8dfa5effd257295f10062"}
Nov 03 21:48:34.414891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.414821    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"
Nov 03 21:48:34.418575 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.418531    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9" event={"ID":"9adaa258-956e-426e-8912-fae770dfc3d8","Type":"ContainerDied","Data":"1032b0aad0be10de31a6d8e59a6aedc92288bb60e20d1a2bfb553230ecf81707"}
Nov 03 21:48:34.418713 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.418617    6774 scope.go:122] "RemoveContainer" containerID="256c4ce508b9686fc98ad3fd047e8783e67b16c388c3702523d4b6d276414477"
Nov 03 21:48:34.418781 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.418547    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"
Nov 03 21:48:34.611596 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.590755    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"]
Nov 03 21:48:34.617826 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.617767    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-qfqjv"]
Nov 03 21:48:34.736352 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.736274    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"]
Nov 03 21:48:34.788446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.787818    6774 patch_prober.go:29] interesting pod/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:34.788446 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.787879    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:34.792295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:34.792263    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4eced5-openshift-default-75c5d85f9f-vmfg9"]
Nov 03 21:48:35.450741 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:35.450700    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:35.451131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:35.450763    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:35.667684 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:35.667649    6774 patch_prober.go:29] interesting pod/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:35.667884 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:35.667715    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:36.160113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.160071    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" path="/var/lib/kubelet/pods/04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c/volumes"
Nov 03 21:48:36.160848 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.160825    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" path="/var/lib/kubelet/pods/9adaa258-956e-426e-8912-fae770dfc3d8/volumes"
Nov 03 21:48:36.198027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.197984    6774 patch_prober.go:29] interesting pod/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:36.198171 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.198048    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:36.437305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.437208    6774 generic.go:356] "Generic (PLEG): container finished" podID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerID="23f2a60dad10410f8fd891b8be135ab542e5a29d056351152e4f44b77761065b" exitCode=0
Nov 03 21:48:36.437305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.437265    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" event={"ID":"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55","Type":"ContainerDied","Data":"23f2a60dad10410f8fd891b8be135ab542e5a29d056351152e4f44b77761065b"}
Nov 03 21:48:36.704779 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.703575    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738122    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738221    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738297    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738362    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738402    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738511    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738554    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738634    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.738693    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo\") pod \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\" (UID: \"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55\") "
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.739315    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.740281    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.740505    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.740565    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.740620    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.740667    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.745605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.743320    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.750772 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.750718    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "kube-api-access-6zprl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:36.751061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.751022    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:36.753656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.753607    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo" pod "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" (UID: "9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:36.767322 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.767286    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:48:36.840869 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.840813    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841056 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.840904    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841056 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.840947    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841068    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841170 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841111    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841264 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841199    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841264 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841247    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841367 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841285    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841367 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841326    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket\") pod \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\" (UID: \"c5f7d167-1319-4d54-9ad6-bf92e1a615d4\") "
Nov 03 21:48:36.841616 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841589    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.841988 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.841965    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842046    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842066    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842081    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842098    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842111    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zprl\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-kube-api-access-6zprl\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842126    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842139    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.842309 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842153    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.843274 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.842770    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.845289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.845228    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.847319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.845604    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "kube-api-access-6r2w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:36.847319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.845623    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:36.847319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.845926    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.847319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.846374    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:36.847319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.847178    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:36.848831 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.848795    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token" pod "c5f7d167-1319-4d54-9ad6-bf92e1a615d4" (UID: "c5f7d167-1319-4d54-9ad6-bf92e1a615d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:36.926647 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.926615    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:48:36.943255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943220    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943248    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943255 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943264    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943275    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943284    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943291    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943300    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r2w9\" (UniqueName: \"kubernetes.io/projected/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-kube-api-access-6r2w9\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:36.943500 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:36.943308    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5f7d167-1319-4d54-9ad6-bf92e1a615d4-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.044498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044397    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.044498 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044481    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.044686 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044610    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.044686 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044679    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.044803 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044776    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.044803 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044775    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:37.044914 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044805    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.044914 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044868    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.045020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044913    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.045020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.044954    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz\") pod \"c317210d-c74a-4470-8ba9-e9467d55e78a\" (UID: \"c317210d-c74a-4470-8ba9-e9467d55e78a\") "
Nov 03 21:48:37.045020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045007    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:37.045166 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045048    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:37.045314 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045286    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:37.045451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045306    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:37.045513 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045492    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.045574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045513    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c317210d-c74a-4470-8ba9-e9467d55e78a-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.045574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045527    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.045574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045542    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.045574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.045564    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.046917 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.046891    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:37.047114 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.047093    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:37.047165 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.047146    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:37.047534 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.047512    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz" pod "c317210d-c74a-4470-8ba9-e9467d55e78a" (UID: "c317210d-c74a-4470-8ba9-e9467d55e78a"). InnerVolumeSpecName "kube-api-access-kkdhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:37.147260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.147212    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.147260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.147244    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.147260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.147254    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkdhz\" (UniqueName: \"kubernetes.io/projected/c317210d-c74a-4470-8ba9-e9467d55e78a-kube-api-access-kkdhz\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.147260 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.147265    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c317210d-c74a-4470-8ba9-e9467d55e78a-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:37.446198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.446159    6774 generic.go:356] "Generic (PLEG): container finished" podID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerID="cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa" exitCode=0
Nov 03 21:48:37.446401 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.446344    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"
Nov 03 21:48:37.447037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.447005    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" event={"ID":"c317210d-c74a-4470-8ba9-e9467d55e78a","Type":"ContainerDied","Data":"cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa"}
Nov 03 21:48:37.447154 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.447089    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795" event={"ID":"c317210d-c74a-4470-8ba9-e9467d55e78a","Type":"ContainerDied","Data":"1539ff2e8552e425fa426b80df770f3f0929cb64a5a736e92c7dc5dc5e2791c5"}
Nov 03 21:48:37.447154 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.447125    6774 scope.go:122] "RemoveContainer" containerID="cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa"
Nov 03 21:48:37.449191 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.449167    6774 generic.go:356] "Generic (PLEG): container finished" podID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerID="d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885" exitCode=0
Nov 03 21:48:37.449292 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.449269    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" event={"ID":"c5f7d167-1319-4d54-9ad6-bf92e1a615d4","Type":"ContainerDied","Data":"d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885"}
Nov 03 21:48:37.449353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.449312    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt" event={"ID":"c5f7d167-1319-4d54-9ad6-bf92e1a615d4","Type":"ContainerDied","Data":"3cc10b57024285f9d0191cd23984ee1587685a4df605983bf15c06c05ad5691f"}
Nov 03 21:48:37.449405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.449383    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"
Nov 03 21:48:37.451347 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.451319    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t" event={"ID":"9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55","Type":"ContainerDied","Data":"7272de503aa414b2a99707c57306900da8c54b0dfdb76f57c61453b76c064bc7"}
Nov 03 21:48:37.451476 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.451458    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"
Nov 03 21:48:37.469195 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.469167    6774 scope.go:122] "RemoveContainer" containerID="cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa"
Nov 03 21:48:37.469585 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:37.469550    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa\": container with ID starting with cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa not found: ID does not exist" containerID="cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa"
Nov 03 21:48:37.469683 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.469591    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa"} err="failed to get container status \"cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa\": rpc error: code = NotFound desc = could not find container \"cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa\": container with ID starting with cf3302b03c79407863fd27d2f288148a5a57ea5e0663b22e165c16b031a92eaa not found: ID does not exist"
Nov 03 21:48:37.469683 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.469608    6774 scope.go:122] "RemoveContainer" containerID="d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885"
Nov 03 21:48:37.481227 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.481208    6774 scope.go:122] "RemoveContainer" containerID="d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885"
Nov 03 21:48:37.481537 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:37.481516    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885\": container with ID starting with d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885 not found: ID does not exist" containerID="d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885"
Nov 03 21:48:37.481643 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.481543    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885"} err="failed to get container status \"d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885\": rpc error: code = NotFound desc = could not find container \"d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885\": container with ID starting with d965ff72a597787bbd69558f64113f084cee50d916fca3de938c7b44d1dd9885 not found: ID does not exist"
Nov 03 21:48:37.481643 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.481569    6774 scope.go:122] "RemoveContainer" containerID="23f2a60dad10410f8fd891b8be135ab542e5a29d056351152e4f44b77761065b"
Nov 03 21:48:37.517093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.517060    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"]
Nov 03 21:48:37.530479 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.530449    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-tz795"]
Nov 03 21:48:37.601871 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.601821    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"]
Nov 03 21:48:37.607518 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.607480    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-hl5vt"]
Nov 03 21:48:37.617024 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.616980    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"]
Nov 03 21:48:37.620774 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.620748    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e246f9-openshift-default-65c46599d9-t968t"]
Nov 03 21:48:37.963092 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:37.963065    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.059577    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.059642    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.059740    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.059805    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.059890    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.059926    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.060000    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.060048    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.060090    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo\") pod \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\" (UID: \"130b25e9-a5f7-4ca1-a20f-e41e07700c2c\") "
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.060514    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.060756    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.063922    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.064118    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.064596    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:38.067523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.066350    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:38.068371 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.067783    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:38.068371 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.067782    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:38.069404 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.069386    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz" pod "130b25e9-a5f7-4ca1-a20f-e41e07700c2c" (UID: "130b25e9-a5f7-4ca1-a20f-e41e07700c2c"). InnerVolumeSpecName "kube-api-access-rkwqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:38.161252 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161160    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" path="/var/lib/kubelet/pods/9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55/volumes"
Nov 03 21:48:38.161666 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161640    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161668    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkwqz\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-kube-api-access-rkwqz\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161682    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161695    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161707    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161719    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161730    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161742    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.161788 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161753    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/130b25e9-a5f7-4ca1-a20f-e41e07700c2c-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:38.162061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.161789    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" path="/var/lib/kubelet/pods/c317210d-c74a-4470-8ba9-e9467d55e78a/volumes"
Nov 03 21:48:38.162371 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.162343    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" path="/var/lib/kubelet/pods/c5f7d167-1319-4d54-9ad6-bf92e1a615d4/volumes"
Nov 03 21:48:38.458151 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.458068    6774 generic.go:356] "Generic (PLEG): container finished" podID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerID="5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c" exitCode=0
Nov 03 21:48:38.458151 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.458115    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"
Nov 03 21:48:38.458359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.458154    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" event={"ID":"130b25e9-a5f7-4ca1-a20f-e41e07700c2c","Type":"ContainerDied","Data":"5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c"}
Nov 03 21:48:38.458359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.458210    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp" event={"ID":"130b25e9-a5f7-4ca1-a20f-e41e07700c2c","Type":"ContainerDied","Data":"3b0a475bef8e67dd61f64741e97d0c6f20f5d9f4eab4b05602445042a1a2ed40"}
Nov 03 21:48:38.458359 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.458241    6774 scope.go:122] "RemoveContainer" containerID="5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c"
Nov 03 21:48:38.468589 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.468569    6774 scope.go:122] "RemoveContainer" containerID="5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c"
Nov 03 21:48:38.468894 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:38.468852    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c\": container with ID starting with 5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c not found: ID does not exist" containerID="5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c"
Nov 03 21:48:38.468999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.468891    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c"} err="failed to get container status \"5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c\": rpc error: code = NotFound desc = could not find container \"5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c\": container with ID starting with 5348e2c6b8e0285e8ae35c809810f78577bacf6f065f01ce5287da964500ca6c not found: ID does not exist"
Nov 03 21:48:38.515100 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.515061    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"]
Nov 03 21:48:38.527002 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.526974    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-fd5wp"]
Nov 03 21:48:38.704135 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.704093    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"]
Nov 03 21:48:38.711519 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:38.711364    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-27fdf4-bh7rv"]
Nov 03 21:48:39.472656 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.472622    6774 generic.go:356] "Generic (PLEG): container finished" podID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerID="267192e2cd3eca58d0ffca623b8d0642dd0c8b032876a8fe5ea041eb96f12e3a" exitCode=0
Nov 03 21:48:39.473142 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.472707    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" event={"ID":"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a","Type":"ContainerDied","Data":"267192e2cd3eca58d0ffca623b8d0642dd0c8b032876a8fe5ea041eb96f12e3a"}
Nov 03 21:48:39.474353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.474278    6774 generic.go:356] "Generic (PLEG): container finished" podID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerID="0272d16d5841432d9843154030d363faa611f5e5ae96d2a64a51eab2667ad9d8" exitCode=0
Nov 03 21:48:39.474353 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.474310    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" event={"ID":"7dcff539-ca9a-41bb-9be6-e8a658863884","Type":"ContainerDied","Data":"0272d16d5841432d9843154030d363faa611f5e5ae96d2a64a51eab2667ad9d8"}
Nov 03 21:48:39.630937 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.630916    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:48:39.632942 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.632907    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:48:39.679380 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679350    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.679567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679395    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.679567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679449    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.679567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679500    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.679567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679541    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.679784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679607    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.679784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679625    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.679784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679637    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.679784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679736    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.679983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679816    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.679983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679858    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.679983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679892    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.679983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679924    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.679983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679958    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.679983 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.679979    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.680281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680034    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.680281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680090    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.680281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680144    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.680281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680199    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket\") pod \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\" (UID: \"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a\") "
Nov 03 21:48:39.680281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680270    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data\") pod \"7dcff539-ca9a-41bb-9be6-e8a658863884\" (UID: \"7dcff539-ca9a-41bb-9be6-e8a658863884\") "
Nov 03 21:48:39.680281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680274    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.680635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680297    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.680635 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680569    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:39.680870 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680848    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.680939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680874    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.680939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680889    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.680939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680905    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.680939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.680919    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.681141 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.681021    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.681660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.681216    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.681660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.681587    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.681660 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.681624    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:39.682037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.681992    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.682524 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.682486    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:39.682631 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.682586    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:39.682631 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.682593    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:39.682895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.682846    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:39.682998 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.682908    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.683069 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.683011    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl" pod "7dcff539-ca9a-41bb-9be6-e8a658863884" (UID: "7dcff539-ca9a-41bb-9be6-e8a658863884"). InnerVolumeSpecName "kube-api-access-shgrl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:39.683455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.683407    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:39.683690 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.683667    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t" pod "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" (UID: "cc3171c4-cfc7-4bb2-88f2-71a479c3c31a"). InnerVolumeSpecName "kube-api-access-hlf4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:39.781550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781517    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781543    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shgrl\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-kube-api-access-shgrl\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781558    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781572    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781581    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dcff539-ca9a-41bb-9be6-e8a658863884-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781589    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlf4t\" (UniqueName: \"kubernetes.io/projected/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-kube-api-access-hlf4t\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781597    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781606    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781614    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781622    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781630    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781639    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dcff539-ca9a-41bb-9be6-e8a658863884-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:39.781856 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:39.781645    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:40.159034 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.158998    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" path="/var/lib/kubelet/pods/130b25e9-a5f7-4ca1-a20f-e41e07700c2c/volumes"
Nov 03 21:48:40.159473 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.159448    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="310d18ab-d068-4bd1-bb1a-73dab67664f0" path="/var/lib/kubelet/pods/310d18ab-d068-4bd1-bb1a-73dab67664f0/volumes"
Nov 03 21:48:40.481778 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.481691    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"
Nov 03 21:48:40.482303 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.481690    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b" event={"ID":"cc3171c4-cfc7-4bb2-88f2-71a479c3c31a","Type":"ContainerDied","Data":"5f6974ac2aed92133daa61b9b228bc5edb6c8c5549d15fb1cac892d5ab7e88ba"}
Nov 03 21:48:40.482303 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.481852    6774 scope.go:122] "RemoveContainer" containerID="267192e2cd3eca58d0ffca623b8d0642dd0c8b032876a8fe5ea041eb96f12e3a"
Nov 03 21:48:40.483130 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.483104    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"
Nov 03 21:48:40.483248 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.483127    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw" event={"ID":"7dcff539-ca9a-41bb-9be6-e8a658863884","Type":"ContainerDied","Data":"270a3ac765667d4fe9df531284369503fab95703a1553c010ef0a362aa885500"}
Nov 03 21:48:40.491594 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.491577    6774 scope.go:122] "RemoveContainer" containerID="0272d16d5841432d9843154030d363faa611f5e5ae96d2a64a51eab2667ad9d8"
Nov 03 21:48:40.549192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.549162    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"]
Nov 03 21:48:40.562239 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.562212    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-qpj9b"]
Nov 03 21:48:40.600807 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.600778    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"]
Nov 03 21:48:40.606482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:40.606456    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-hxxgw"]
Nov 03 21:48:41.085679 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:41.085647    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:41.245900 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:41.245861    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:42.130321 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.130298    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:42.153310 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.153288    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:42.159505 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.159481    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" path="/var/lib/kubelet/pods/7dcff539-ca9a-41bb-9be6-e8a658863884/volumes"
Nov 03 21:48:42.159952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.159938    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" path="/var/lib/kubelet/pods/cc3171c4-cfc7-4bb2-88f2-71a479c3c31a/volumes"
Nov 03 21:48:42.211695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211608    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.211695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211655    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.211695 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211674    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211701    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211729    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211773    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211810    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211840    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211882    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211942    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.211972 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211974    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212004    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212067    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212112    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212142    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212205    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212256    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data\") pod \"fda5afff-05fd-4ed1-92cc-529edb057553\" (UID: \"fda5afff-05fd-4ed1-92cc-529edb057553\") "
Nov 03 21:48:42.212356 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212292    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo\") pod \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\" (UID: \"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8\") "
Nov 03 21:48:42.212832 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211965    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.211973    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212191    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212207    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212285    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212549    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212775    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.212895 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.212718    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:42.213248 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.213064    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.213688 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.213652    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.215290 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.215266    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "kube-api-access-x8ncg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:42.216395 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.216370    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.216601 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.216388    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "kube-api-access-wv57q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:42.216601 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.216474    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:42.216601 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.216492    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:42.216601 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.216584    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:42.216829 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.216707    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo" pod "fda5afff-05fd-4ed1-92cc-529edb057553" (UID: "fda5afff-05fd-4ed1-92cc-529edb057553"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:42.217697 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.217673    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token" pod "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" (UID: "19a25f18-8ebf-40ed-b4b0-2e1140fdeef8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:42.313941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313904    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fda5afff-05fd-4ed1-92cc-529edb057553-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.313941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313933    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.313941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313942    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.313941 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313951    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8ncg\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-kube-api-access-x8ncg\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313961    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313969    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313978    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313985    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.313994    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314001    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314008    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314015    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314023    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fda5afff-05fd-4ed1-92cc-529edb057553-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314032    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv57q\" (UniqueName: \"kubernetes.io/projected/fda5afff-05fd-4ed1-92cc-529edb057553-kube-api-access-wv57q\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314040    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314048    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fda5afff-05fd-4ed1-92cc-529edb057553-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314056    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.314192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.314063    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:42.499852 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.499762    6774 generic.go:356] "Generic (PLEG): container finished" podID="fda5afff-05fd-4ed1-92cc-529edb057553" containerID="6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418" exitCode=0
Nov 03 21:48:42.499852 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.499820    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"
Nov 03 21:48:42.500058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.499851    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" event={"ID":"fda5afff-05fd-4ed1-92cc-529edb057553","Type":"ContainerDied","Data":"6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418"}
Nov 03 21:48:42.500058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.499901    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8" event={"ID":"fda5afff-05fd-4ed1-92cc-529edb057553","Type":"ContainerDied","Data":"c95e1e9deac1ca8e50108c2f06a4bbb60e365e8f0b52241a0d9e5c2a6be2407b"}
Nov 03 21:48:42.500058 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.499923    6774 scope.go:122] "RemoveContainer" containerID="6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418"
Nov 03 21:48:42.501282 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.501257    6774 generic.go:356] "Generic (PLEG): container finished" podID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerID="64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa" exitCode=0
Nov 03 21:48:42.501358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.501307    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"
Nov 03 21:48:42.501358 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.501330    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" event={"ID":"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8","Type":"ContainerDied","Data":"64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa"}
Nov 03 21:48:42.501512 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.501383    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc" event={"ID":"19a25f18-8ebf-40ed-b4b0-2e1140fdeef8","Type":"ContainerDied","Data":"dde237c508e0cf6f9eec2b6e20ae916009933a40f87e15f3004e689e8838eba2"}
Nov 03 21:48:42.511925 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.511906    6774 scope.go:122] "RemoveContainer" containerID="6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418"
Nov 03 21:48:42.512227 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:42.512200    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418\": container with ID starting with 6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418 not found: ID does not exist" containerID="6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418"
Nov 03 21:48:42.512295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.512236    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418"} err="failed to get container status \"6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418\": rpc error: code = NotFound desc = could not find container \"6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418\": container with ID starting with 6453b4676402d6567e76256cd3a1a964a9d62aa67f1b7319718cc9ce027ed418 not found: ID does not exist"
Nov 03 21:48:42.512295 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.512252    6774 scope.go:122] "RemoveContainer" containerID="64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa"
Nov 03 21:48:42.521093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.521075    6774 scope.go:122] "RemoveContainer" containerID="64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa"
Nov 03 21:48:42.521376 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:42.521356    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa\": container with ID starting with 64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa not found: ID does not exist" containerID="64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa"
Nov 03 21:48:42.521442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.521383    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa"} err="failed to get container status \"64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa\": rpc error: code = NotFound desc = could not find container \"64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa\": container with ID starting with 64086bd41c809a46717443eae66ea76613dd28231c4a54ab33d328efe8dac5aa not found: ID does not exist"
Nov 03 21:48:42.556145 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.556120    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"]
Nov 03 21:48:42.569168 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.569142    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-05bc27-openshift-default-6df586d6ff-5hcp8"]
Nov 03 21:48:42.604477 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.604447    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"]
Nov 03 21:48:42.613550 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:42.613511    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-0a6da1-openshift-default-5d8fb4b669-bddxc"]
Nov 03 21:48:44.158305 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:44.158273    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" path="/var/lib/kubelet/pods/19a25f18-8ebf-40ed-b4b0-2e1140fdeef8/volumes"
Nov 03 21:48:44.158770 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:44.158755    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" path="/var/lib/kubelet/pods/fda5afff-05fd-4ed1-92cc-529edb057553/volumes"
Nov 03 21:48:45.839499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:45.839051    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"]
Nov 03 21:48:45.839499 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:45.839327    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" containerID="cri-o://2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454" gracePeriod=30
Nov 03 21:48:45.852588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:45.852551    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"]
Nov 03 21:48:45.856469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:45.852826    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" containerID="cri-o://d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7" gracePeriod=30
Nov 03 21:48:45.868558 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:45.868525    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"]
Nov 03 21:48:45.868776 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:45.868749    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" containerID="cri-o://9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7" gracePeriod=30
Nov 03 21:48:48.030838 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:48.030799    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:48.031221 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:48.030857    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:48.111755 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:48.111720    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"]
Nov 03 21:48:50.135165 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:50.135129    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:50.135559 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:50.135191    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:50.701280 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:50.701235    6774 patch_prober.go:29] interesting pod/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 03 21:48:50.701617 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:50.701314    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 03 21:48:51.149276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.149248    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:48:51.167836 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.167813    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:48:51.175405 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.175383    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:48:51.316184 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316100    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.316355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316217    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.316355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316255    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316284    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.316355 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316328    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316375    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316413    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316455    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316487    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316516    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316546    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316590 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316573    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316606    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316635    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316667    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316697    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316725    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316755    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316786    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316823    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.316910 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316859    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.317327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316950    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.317327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.316975    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.317327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.317002    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket\") pod \"916ee91f-15b0-43c9-922c-4feff20ad29d\" (UID: \"916ee91f-15b0-43c9-922c-4feff20ad29d\") "
Nov 03 21:48:51.317327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.317026    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert\") pod \"13fd7636-3776-4ffc-93b5-707a399834d4\" (UID: \"13fd7636-3776-4ffc-93b5-707a399834d4\") "
Nov 03 21:48:51.317327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.317051    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.317327 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.317072    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7\") pod \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\" (UID: \"f4513bd0-8f2e-4b39-8803-42fd08e8a3be\") "
Nov 03 21:48:51.318171 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.318054    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.318171 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.318095    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.318376 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.318356    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.318454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.318365    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.318833 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.318807    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:51.318939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.318893    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.319114 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.319093    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.319187 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.319175    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:51.319872 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.319265    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.319872 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.319314    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.319872 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.319621    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.319872 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.319717    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:51.320216 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.320171    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.320331 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.320293    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.320394 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.320354    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.320894 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.320406    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.320894 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.320870    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.321093 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.321069    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "kube-api-access-ttwmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:51.321542 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.321514    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:51.322036 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.321988    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:51.322185 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.322159    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "kube-api-access-ncfh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:51.322465 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.322413    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "kube-api-access-szwld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:51.322631 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.322615    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:51.322957 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.322942    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:51.323671 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.323651    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token" pod "13fd7636-3776-4ffc-93b5-707a399834d4" (UID: "13fd7636-3776-4ffc-93b5-707a399834d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:51.323747 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.323692    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy" pod "f4513bd0-8f2e-4b39-8803-42fd08e8a3be" (UID: "f4513bd0-8f2e-4b39-8803-42fd08e8a3be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:48:51.323946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.323929    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo" pod "916ee91f-15b0-43c9-922c-4feff20ad29d" (UID: "916ee91f-15b0-43c9-922c-4feff20ad29d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:48:51.418982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.418950    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.418982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.418977    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.418982 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.418988    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13fd7636-3776-4ffc-93b5-707a399834d4-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.418997    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419005    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419013    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13fd7636-3776-4ffc-93b5-707a399834d4-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419021    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419030    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncfh7\" (UniqueName: \"kubernetes.io/projected/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-kube-api-access-ncfh7\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419038    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419046    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419054    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419061    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419069    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419076    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419085    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419093    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419100    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419109    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4513bd0-8f2e-4b39-8803-42fd08e8a3be-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419118    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419126    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13fd7636-3776-4ffc-93b5-707a399834d4-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419133    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419140    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419148    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/916ee91f-15b0-43c9-922c-4feff20ad29d-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419157    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szwld\" (UniqueName: \"kubernetes.io/projected/916ee91f-15b0-43c9-922c-4feff20ad29d-kube-api-access-szwld\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419166    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttwmz\" (UniqueName: \"kubernetes.io/projected/13fd7636-3776-4ffc-93b5-707a399834d4-kube-api-access-ttwmz\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419175    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.419203 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.419183    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/916ee91f-15b0-43c9-922c-4feff20ad29d-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:51.562122 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.562085    6774 generic.go:356] "Generic (PLEG): container finished" podID="13fd7636-3776-4ffc-93b5-707a399834d4" containerID="d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7" exitCode=0
Nov 03 21:48:51.562281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.562126    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"
Nov 03 21:48:51.562281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.562163    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" event={"ID":"13fd7636-3776-4ffc-93b5-707a399834d4","Type":"ContainerDied","Data":"d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7"}
Nov 03 21:48:51.562281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.562215    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5" event={"ID":"13fd7636-3776-4ffc-93b5-707a399834d4","Type":"ContainerDied","Data":"9ed85034dbb931bac94e7271aa0380727512aa6195d264ca55860903fc23b10b"}
Nov 03 21:48:51.562281 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.562237    6774 scope.go:122] "RemoveContainer" containerID="d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7"
Nov 03 21:48:51.564084 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.564061    6774 generic.go:356] "Generic (PLEG): container finished" podID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerID="2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454" exitCode=0
Nov 03 21:48:51.564233 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.564125    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"
Nov 03 21:48:51.564233 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.564151    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" event={"ID":"916ee91f-15b0-43c9-922c-4feff20ad29d","Type":"ContainerDied","Data":"2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454"}
Nov 03 21:48:51.564233 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.564206    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl" event={"ID":"916ee91f-15b0-43c9-922c-4feff20ad29d","Type":"ContainerDied","Data":"5bc74b531e7aa8a4163deb64425b105b787b2c89e2a66d8f21988756912cd188"}
Nov 03 21:48:51.565969 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.565887    6774 generic.go:356] "Generic (PLEG): container finished" podID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerID="9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7" exitCode=0
Nov 03 21:48:51.565969 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.565951    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"
Nov 03 21:48:51.566132 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.565954    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" event={"ID":"f4513bd0-8f2e-4b39-8803-42fd08e8a3be","Type":"ContainerDied","Data":"9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7"}
Nov 03 21:48:51.566132 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.566079    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9" event={"ID":"f4513bd0-8f2e-4b39-8803-42fd08e8a3be","Type":"ContainerDied","Data":"495f27b450345359358a8df4ec86713e9cdf1c87268df226330c9f8435b4d783"}
Nov 03 21:48:51.574636 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.574603    6774 scope.go:122] "RemoveContainer" containerID="d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7"
Nov 03 21:48:51.574990 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:51.574917    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7\": container with ID starting with d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7 not found: ID does not exist" containerID="d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7"
Nov 03 21:48:51.574990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.574950    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7"} err="failed to get container status \"d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7\": rpc error: code = NotFound desc = could not find container \"d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7\": container with ID starting with d87d298dd26807727bc95afeca5fb47ce37e963976144360232abfc5f066a0d7 not found: ID does not exist"
Nov 03 21:48:51.574990 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.574969    6774 scope.go:122] "RemoveContainer" containerID="2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454"
Nov 03 21:48:51.585238 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.585218    6774 scope.go:122] "RemoveContainer" containerID="2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454"
Nov 03 21:48:51.585507 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:51.585491    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454\": container with ID starting with 2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454 not found: ID does not exist" containerID="2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454"
Nov 03 21:48:51.585577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.585512    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454"} err="failed to get container status \"2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454\": rpc error: code = NotFound desc = could not find container \"2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454\": container with ID starting with 2d00ff16aac7d4117cd2d6cd0ed8b3dab6b720465994957d8f92f383a5a5e454 not found: ID does not exist"
Nov 03 21:48:51.585577 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.585528    6774 scope.go:122] "RemoveContainer" containerID="9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7"
Nov 03 21:48:51.594643 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.594624    6774 scope.go:122] "RemoveContainer" containerID="9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7"
Nov 03 21:48:51.594885 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:48:51.594868    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7\": container with ID starting with 9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7 not found: ID does not exist" containerID="9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7"
Nov 03 21:48:51.594939 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.594890    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7"} err="failed to get container status \"9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7\": rpc error: code = NotFound desc = could not find container \"9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7\": container with ID starting with 9eabac590b2351801259417fbc88722e752ab196163c816ef19eb9efa51dbac7 not found: ID does not exist"
Nov 03 21:48:51.646328 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.646297    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"]
Nov 03 21:48:51.659227 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.659199    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-xbmc9"]
Nov 03 21:48:51.693916 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.693885    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"]
Nov 03 21:48:51.697630 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.697608    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-vfxkl"]
Nov 03 21:48:51.732094 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.732066    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"]
Nov 03 21:48:51.735745 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:51.735715    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-27fdf4-openshift-default-67c598bf99-bnks5"]
Nov 03 21:48:52.159237 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:52.159163    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" path="/var/lib/kubelet/pods/13fd7636-3776-4ffc-93b5-707a399834d4/volumes"
Nov 03 21:48:52.159761 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:52.159744    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" path="/var/lib/kubelet/pods/916ee91f-15b0-43c9-922c-4feff20ad29d/volumes"
Nov 03 21:48:52.160269 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:52.160255    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" path="/var/lib/kubelet/pods/f4513bd0-8f2e-4b39-8803-42fd08e8a3be/volumes"
Nov 03 21:48:53.756877 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:53.756837    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"]
Nov 03 21:48:54.979027 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.978992    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"]
Nov 03 21:48:54.979445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979400    6774 cpu_manager.go:414] "containerMap: removing container" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy"
Nov 03 21:48:54.979445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979412    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979452    6774 cpu_manager.go:414] "containerMap: removing container" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979457    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979464    6774 cpu_manager.go:414] "containerMap: removing container" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979470    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979478    6774 cpu_manager.go:414] "containerMap: removing container" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979483    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979495    6774 cpu_manager.go:414] "containerMap: removing container" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979499    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979505    6774 cpu_manager.go:414] "containerMap: removing container" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979510    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979517    6774 cpu_manager.go:414] "containerMap: removing container" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979521    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979527    6774 cpu_manager.go:414] "containerMap: removing container" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979533    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979543    6774 cpu_manager.go:414] "containerMap: removing container" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979549    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979559    6774 cpu_manager.go:414] "containerMap: removing container" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979565    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979577    6774 cpu_manager.go:414] "containerMap: removing container" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979582    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979592    6774 cpu_manager.go:414] "containerMap: removing container" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979596    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979606    6774 cpu_manager.go:414] "containerMap: removing container" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979610    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979625    6774 cpu_manager.go:414] "containerMap: removing container" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979634    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979724    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="916ee91f-15b0-43c9-922c-4feff20ad29d" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979737    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="19a25f18-8ebf-40ed-b4b0-2e1140fdeef8" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979749    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="fda5afff-05fd-4ed1-92cc-529edb057553" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979758    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="9adaa258-956e-426e-8912-fae770dfc3d8" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979765    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="04fb47d8-e3be-4f54-b8df-ca78c4a5bb3c" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979773    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="c317210d-c74a-4470-8ba9-e9467d55e78a" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979783    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4513bd0-8f2e-4b39-8803-42fd08e8a3be" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979793    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5f7d167-1319-4d54-9ad6-bf92e1a615d4" containerName="istio-proxy"
Nov 03 21:48:54.979773 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979799    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="7dcff539-ca9a-41bb-9be6-e8a658863884" containerName="istio-proxy"
Nov 03 21:48:54.980968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979806    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="703634ce-d518-4b85-a5bb-31e1ac3aa8a9" containerName="istio-proxy"
Nov 03 21:48:54.980968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979813    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="13fd7636-3776-4ffc-93b5-707a399834d4" containerName="istio-proxy"
Nov 03 21:48:54.980968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979819    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc3171c4-cfc7-4bb2-88f2-71a479c3c31a" containerName="istio-proxy"
Nov 03 21:48:54.980968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979825    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="9bc74c68-4ad1-49b8-80d6-3d74d9a1cf55" containerName="istio-proxy"
Nov 03 21:48:54.980968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.979831    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="130b25e9-a5f7-4ca1-a20f-e41e07700c2c" containerName="istio-proxy"
Nov 03 21:48:54.985207 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:54.985183    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.001290 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.001265    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"]
Nov 03 21:48:55.012064 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.012034    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 21:48:55.012235 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.012115    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 21:48:55.084974 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.084943    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 03 21:48:55.085148 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.085108    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 21:48:55.165627 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.165598    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kx24\" (UniqueName: \"kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.165784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.165632    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.165784 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.165665    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.267307 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.267227    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kx24\" (UniqueName: \"kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.267307 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.267260    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.267588 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.267394    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.268037 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.268011    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.269610 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.269589    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.287216 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.287191    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kx24\" (UniqueName: \"kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24\") pod \"maas-api-revoke-sub-1c40cee1-6qvvs\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.298944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.298919    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:55.594836 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:55.594810    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"]
Nov 03 21:48:55.597754 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:48:55.597726    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5514e96e_108b_4759_9084_ef75147ad928.slice/crio-16af05e05fa4427bbfbc073921053425cb9ec7f41455895db577b25b5a851f7d WatchSource:0}: Error finding container 16af05e05fa4427bbfbc073921053425cb9ec7f41455895db577b25b5a851f7d: Status 404 returned error can't find the container with id 16af05e05fa4427bbfbc073921053425cb9ec7f41455895db577b25b5a851f7d
Nov 03 21:48:56.601434 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:56.601388    6774 generic.go:356] "Generic (PLEG): container finished" podID="5514e96e-108b-4759-9084-ef75147ad928" containerID="7380f95c92a9cbebc7929b81e26d3e64abadd1ea952e299bd0c20bafe87aea05" exitCode=0
Nov 03 21:48:56.601809 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:56.601451    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs" event={"ID":"5514e96e-108b-4759-9084-ef75147ad928","Type":"ContainerDied","Data":"7380f95c92a9cbebc7929b81e26d3e64abadd1ea952e299bd0c20bafe87aea05"}
Nov 03 21:48:56.601809 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:56.601510    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs" event={"ID":"5514e96e-108b-4759-9084-ef75147ad928","Type":"ContainerStarted","Data":"16af05e05fa4427bbfbc073921053425cb9ec7f41455895db577b25b5a851f7d"}
Nov 03 21:48:57.749333 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.749305    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:57.796729 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.796689    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24\" (UniqueName: \"kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24\") pod \"5514e96e-108b-4759-9084-ef75147ad928\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") "
Nov 03 21:48:57.796904 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.796737    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca\") pod \"5514e96e-108b-4759-9084-ef75147ad928\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") "
Nov 03 21:48:57.796904 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.796852    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca\") pod \"5514e96e-108b-4759-9084-ef75147ad928\" (UID: \"5514e96e-108b-4759-9084-ef75147ad928\") "
Nov 03 21:48:57.797192 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.797164    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca" pod "5514e96e-108b-4759-9084-ef75147ad928" (UID: "5514e96e-108b-4759-9084-ef75147ad928"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:48:57.799109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.798966    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca" pod "5514e96e-108b-4759-9084-ef75147ad928" (UID: "5514e96e-108b-4759-9084-ef75147ad928"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:48:57.799109 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.799059    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24" pod "5514e96e-108b-4759-9084-ef75147ad928" (UID: "5514e96e-108b-4759-9084-ef75147ad928"). InnerVolumeSpecName "kube-api-access-6kx24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:48:57.898297 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.898195    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kx24\" (UniqueName: \"kubernetes.io/projected/5514e96e-108b-4759-9084-ef75147ad928-kube-api-access-6kx24\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:57.898297 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.898234    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5514e96e-108b-4759-9084-ef75147ad928-maas-api-openshift-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:57.898297 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:57.898249    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5514e96e-108b-4759-9084-ef75147ad928-maas-api-xks-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:48:58.613206 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:58.613172    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"
Nov 03 21:48:58.613206 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:58.613199    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs" event={"ID":"5514e96e-108b-4759-9084-ef75147ad928","Type":"ContainerDied","Data":"16af05e05fa4427bbfbc073921053425cb9ec7f41455895db577b25b5a851f7d"}
Nov 03 21:48:58.613450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:58.613247    6774 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16af05e05fa4427bbfbc073921053425cb9ec7f41455895db577b25b5a851f7d"
Nov 03 21:48:58.757391 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:48:58.757353    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerName="payload-processing" containerID="cri-o://96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85" gracePeriod=25
Nov 03 21:49:01.398100 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:49:01.398064    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:49:03.132567 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.132526    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main" containerID="cri-o://dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233" gracePeriod=45
Nov 03 21:49:03.384768 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.384709    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:49:03.451685 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.451644    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs\") pod \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") "
Nov 03 21:49:03.451854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.451738    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir\") pod \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") "
Nov 03 21:49:03.451854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.451769    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home\") pod \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") "
Nov 03 21:49:03.451854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.451825    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm\") pod \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") "
Nov 03 21:49:03.452005 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.451869    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7\" (UniqueName: \"kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7\") pod \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") "
Nov 03 21:49:03.452005 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.451976    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache\") pod \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\" (UID: \"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d\") "
Nov 03 21:49:03.452111 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.452040    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir" pod "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" (UID: "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:03.452167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.452123    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home" pod "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" (UID: "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:03.452306 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.452282    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache" pod "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" (UID: "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:03.452726 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.452699    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:03.452891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.452729    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:03.452891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.452743    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:03.454319 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.454280    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7" pod "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" (UID: "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d"). InnerVolumeSpecName "kube-api-access-sl8f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:03.454592 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.454566    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm" pod "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" (UID: "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:03.454707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.454685    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs" pod "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" (UID: "f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:49:03.553796 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.553763    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:03.553796 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.553794    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:03.553968 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.553806    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl8f7\" (UniqueName: \"kubernetes.io/projected/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d-kube-api-access-sl8f7\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:03.642245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.642164    6774 generic.go:356] "Generic (PLEG): container finished" podID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerID="dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233" exitCode=0
Nov 03 21:49:03.642245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.642206    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"
Nov 03 21:49:03.642605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.642243    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" event={"ID":"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d","Type":"ContainerDied","Data":"dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233"}
Nov 03 21:49:03.642605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.642291    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w" event={"ID":"f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d","Type":"ContainerDied","Data":"bfdea7ea0c60f59c44ed1f9bc9323c89bbaaf512214f50c3f451828a4685a413"}
Nov 03 21:49:03.642605 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.642314    6774 scope.go:122] "RemoveContainer" containerID="dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233"
Nov 03 21:49:03.653576 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.653549    6774 scope.go:122] "RemoveContainer" containerID="dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233"
Nov 03 21:49:03.653875 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:49:03.653854    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233\": container with ID starting with dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233 not found: ID does not exist" containerID="dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233"
Nov 03 21:49:03.653958 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.653887    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233"} err="failed to get container status \"dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233\": rpc error: code = NotFound desc = could not find container \"dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233\": container with ID starting with dec9a4b814b9431b97bcccc00abdbd9577b392636bc5e1aaa2bd5d43e41f5233 not found: ID does not exist"
Nov 03 21:49:03.695175 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.695145    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"]
Nov 03 21:49:03.698665 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:03.698640    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-517149/distinct-2-w6-517149-kserve-9fcf48d6f-4bb2w"]
Nov 03 21:49:04.166048 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:04.166016    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" path="/var/lib/kubelet/pods/f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d/volumes"
Nov 03 21:49:08.418080 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:08.418043    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:49:17.419180 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:17.419143    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"]
Nov 03 21:49:17.439012 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:17.438975    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"]
Nov 03 21:49:17.440463 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:17.440411    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy" containerID="cri-o://b709b572f5c7af9bef7641f3bb37558b82729abfcacaebb3a00431a1dc02f417" gracePeriod=30
Nov 03 21:49:17.455603 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:17.455572    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"]
Nov 03 21:49:17.455999 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:17.455966    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy" containerID="cri-o://022cba4b3666321d2994a61ba446b895cd777bc97d878eb40a1e57f5ec44837e" gracePeriod=30
Nov 03 21:49:17.727442 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:17.727322    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy" containerID="cri-o://2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56" gracePeriod=30
Nov 03 21:49:18.417619 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:18.417581    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 03 21:49:19.007843 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.007816    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:49:19.034046 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.033977    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume\") pod \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") "
Nov 03 21:49:19.034159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.034107    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7\" (UniqueName: \"kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7\") pod \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\" (UID: \"2a4dcc05-fefc-4f94-8505-841d9d38ec19\") "
Nov 03 21:49:19.034412 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.034378    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume" pod "2a4dcc05-fefc-4f94-8505-841d9d38ec19" (UID: "2a4dcc05-fefc-4f94-8505-841d9d38ec19"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:49:19.036159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.036140    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7" pod "2a4dcc05-fefc-4f94-8505-841d9d38ec19" (UID: "2a4dcc05-fefc-4f94-8505-841d9d38ec19"). InnerVolumeSpecName "kube-api-access-s6gx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:19.135198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.135158    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6gx7\" (UniqueName: \"kubernetes.io/projected/2a4dcc05-fefc-4f94-8505-841d9d38ec19-kube-api-access-s6gx7\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:19.135198 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.135191    6774 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a4dcc05-fefc-4f94-8505-841d9d38ec19-plugins-config-volume\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:19.739995 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.739953    6774 generic.go:356] "Generic (PLEG): container finished" podID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerID="96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85" exitCode=0
Nov 03 21:49:19.740173 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.740016    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"
Nov 03 21:49:19.740173 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.740031    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" event={"ID":"2a4dcc05-fefc-4f94-8505-841d9d38ec19","Type":"ContainerDied","Data":"96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85"}
Nov 03 21:49:19.740173 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.740108    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2" event={"ID":"2a4dcc05-fefc-4f94-8505-841d9d38ec19","Type":"ContainerDied","Data":"0fc6ea329d3b75ce3e72ff916275a8ea03366ceabe0256837de2e7dbe7d056a2"}
Nov 03 21:49:19.740173 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.740136    6774 scope.go:122] "RemoveContainer" containerID="96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85"
Nov 03 21:49:19.749619 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.749601    6774 scope.go:122] "RemoveContainer" containerID="96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85"
Nov 03 21:49:19.749901 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:49:19.749880    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85\": container with ID starting with 96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85 not found: ID does not exist" containerID="96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85"
Nov 03 21:49:19.749965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.749909    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85"} err="failed to get container status \"96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85\": rpc error: code = NotFound desc = could not find container \"96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85\": container with ID starting with 96039cb9da2339452b914e098552f74c0dd483be987ca303e458f53c2e2a1e85 not found: ID does not exist"
Nov 03 21:49:19.793702 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.793669    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"]
Nov 03 21:49:19.806215 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:19.806192    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w6-517149-544c55bfbd-6z5t2"]
Nov 03 21:49:20.158595 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:20.158555    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" path="/var/lib/kubelet/pods/2a4dcc05-fefc-4f94-8505-841d9d38ec19/volumes"
Nov 03 21:49:22.784043 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.781111    6774 generic.go:356] "Generic (PLEG): container finished" podID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerID="b709b572f5c7af9bef7641f3bb37558b82729abfcacaebb3a00431a1dc02f417" exitCode=0
Nov 03 21:49:22.784043 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.781209    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" event={"ID":"dd1869b1-e189-4c4a-96e9-19e7719acbb2","Type":"ContainerDied","Data":"b709b572f5c7af9bef7641f3bb37558b82729abfcacaebb3a00431a1dc02f417"}
Nov 03 21:49:22.785383 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.785354    6774 generic.go:356] "Generic (PLEG): container finished" podID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerID="022cba4b3666321d2994a61ba446b895cd777bc97d878eb40a1e57f5ec44837e" exitCode=0
Nov 03 21:49:22.785818 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.785733    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" event={"ID":"8dc2cda4-4240-400b-bd7b-d444909c9bce","Type":"ContainerDied","Data":"022cba4b3666321d2994a61ba446b895cd777bc97d878eb40a1e57f5ec44837e"}
Nov 03 21:49:22.905445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.902308    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:49:22.922402 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.922323    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.997880    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.997941    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.997993    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998063    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998099    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998127    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998173    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998230    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998258    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998295    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998324    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998353    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998393    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998443    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.998496 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998474    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:22.999460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998519    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.999460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998563    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token\") pod \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\" (UID: \"dd1869b1-e189-4c4a-96e9-19e7719acbb2\") "
Nov 03 21:49:22.999460 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:22.998597    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket\") pod \"8dc2cda4-4240-400b-bd7b-d444909c9bce\" (UID: \"8dc2cda4-4240-400b-bd7b-d444909c9bce\") "
Nov 03 21:49:23.012782 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.012532    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.013334 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.013005    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.020659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.019942    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:49:23.020659 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.020368    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:49:23.026450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.022777    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.026450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.024715    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.026450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.024730    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.026450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.025087    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.026450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.025150    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.026959 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.026918    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.063632 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.063567    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.065523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.065180    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:23.065523 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.065367    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:23.066744 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.066703    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "kube-api-access-qcjxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:23.066958 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.066927    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.067390 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.067368    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo" pod "dd1869b1-e189-4c4a-96e9-19e7719acbb2" (UID: "dd1869b1-e189-4c4a-96e9-19e7719acbb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:49:23.067924 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.067890    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:49:23.104444 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.093592    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf" pod "8dc2cda4-4240-400b-bd7b-d444909c9bce" (UID: "8dc2cda4-4240-400b-bd7b-d444909c9bce"). InnerVolumeSpecName "kube-api-access-zqczf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:23.127844 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127810    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.127844 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127845    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcjxr\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-kube-api-access-qcjxr\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127860    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127874    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127888    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127902    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127914    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8dc2cda4-4240-400b-bd7b-d444909c9bce-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127928    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127940    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127954    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127966    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqczf\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-kube-api-access-zqczf\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127980    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.127993    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.128009    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.128022    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8dc2cda4-4240-400b-bd7b-d444909c9bce-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.128035    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd1869b1-e189-4c4a-96e9-19e7719acbb2-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.128050    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd1869b1-e189-4c4a-96e9-19e7719acbb2-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.128061 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.128064    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8dc2cda4-4240-400b-bd7b-d444909c9bce-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.333410 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.333382    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:49:23.429992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.429951    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.429992 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.429997    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430040    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430106    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430151    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430180    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430489 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430259    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430489 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430287    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430489 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430341    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket\") pod \"c6c1cf21-5efd-423c-969f-623ba164d70e\" (UID: \"c6c1cf21-5efd-423c-969f-623ba164d70e\") "
Nov 03 21:49:23.430650 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430539    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.430707 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430650    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.430762 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430723    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.430816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430760    6774 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.430816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430781    6774 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-workload-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.430816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430759    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.430965 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.430929    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:49:23.432805 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.432777    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 03 21:49:23.432805 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.432778    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:23.433020 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.433001    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "kube-api-access-cbfvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:49:23.433119 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.433090    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy" pod "c6c1cf21-5efd-423c-969f-623ba164d70e" (UID: "c6c1cf21-5efd-423c-969f-623ba164d70e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532014    6774 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-data\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532047    6774 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-envoy\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532055    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532064    6774 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c1cf21-5efd-423c-969f-623ba164d70e-credential-socket\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532074    6774 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c1cf21-5efd-423c-969f-623ba164d70e-istio-podinfo\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532082    6774 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c1cf21-5efd-423c-969f-623ba164d70e-istiod-ca-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.532113 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.532090    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbfvf\" (UniqueName: \"kubernetes.io/projected/c6c1cf21-5efd-423c-969f-623ba164d70e-kube-api-access-cbfvf\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:49:23.810451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.809990    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h" event={"ID":"8dc2cda4-4240-400b-bd7b-d444909c9bce","Type":"ContainerDied","Data":"8792ea9c2f1405b961892e4e33c3485848e23ad0bebcfb1f988b8e5248232da4"}
Nov 03 21:49:23.810451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.810067    6774 scope.go:122] "RemoveContainer" containerID="022cba4b3666321d2994a61ba446b895cd777bc97d878eb40a1e57f5ec44837e"
Nov 03 21:49:23.810451 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.810183    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"
Nov 03 21:49:23.817639 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.816818    6774 generic.go:356] "Generic (PLEG): container finished" podID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerID="2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56" exitCode=0
Nov 03 21:49:23.817639 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.816866    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" event={"ID":"c6c1cf21-5efd-423c-969f-623ba164d70e","Type":"ContainerDied","Data":"2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56"}
Nov 03 21:49:23.817639 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.816960    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq" event={"ID":"c6c1cf21-5efd-423c-969f-623ba164d70e","Type":"ContainerDied","Data":"c615431b82edc0eb9f1fb703d92e2f3185aae867dbe615d3732feceed21d6a44"}
Nov 03 21:49:23.817639 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.817204    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"
Nov 03 21:49:23.827454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.826502    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9" event={"ID":"dd1869b1-e189-4c4a-96e9-19e7719acbb2","Type":"ContainerDied","Data":"b178fe082c2eb6ec58a5af33d3283d4a590ff461713caf2e3d172f510cc398cd"}
Nov 03 21:49:23.827454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.826653    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"
Nov 03 21:49:23.831761 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.831736    6774 scope.go:122] "RemoveContainer" containerID="2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56"
Nov 03 21:49:23.902464 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.896389    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"]
Nov 03 21:49:23.911447 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.906348    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-h9zbq"]
Nov 03 21:49:23.921655 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.921620    6774 scope.go:122] "RemoveContainer" containerID="2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56"
Nov 03 21:49:23.923004 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:49:23.922969    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56\": container with ID starting with 2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56 not found: ID does not exist" containerID="2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56"
Nov 03 21:49:23.923131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.923019    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56"} err="failed to get container status \"2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56\": rpc error: code = NotFound desc = could not find container \"2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56\": container with ID starting with 2341a1f4fb9cb8a11e1dc6cda71141f24a33f67ca23f0e2f0bb7357082740e56 not found: ID does not exist"
Nov 03 21:49:23.923131 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.923044    6774 scope.go:122] "RemoveContainer" containerID="b709b572f5c7af9bef7641f3bb37558b82729abfcacaebb3a00431a1dc02f417"
Nov 03 21:49:23.989493 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.977831    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"]
Nov 03 21:49:23.991832 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:23.991802    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-zcc6h"]
Nov 03 21:49:24.014153 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.010348    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"]
Nov 03 21:49:24.014153 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.013440    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-517149-openshift-default-5cfb5c6655-7wjp9"]
Nov 03 21:49:24.213450 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.213033    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" path="/var/lib/kubelet/pods/8dc2cda4-4240-400b-bd7b-d444909c9bce/volumes"
Nov 03 21:49:24.214467 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.213967    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" path="/var/lib/kubelet/pods/c6c1cf21-5efd-423c-969f-623ba164d70e/volumes"
Nov 03 21:49:24.214604 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.214582    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" path="/var/lib/kubelet/pods/dd1869b1-e189-4c4a-96e9-19e7719acbb2/volumes"
Nov 03 21:49:24.248455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.247527    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 21:49:24.248455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.247594    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:49:24.268574 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.268537    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 21:49:24.268866 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:24.268819    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:49:31.397158 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:49:31.397121    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:49:40.025948 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:40.025907    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"]
Nov 03 21:49:40.037449 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:40.037406    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ba8353c4-hltps"]
Nov 03 21:49:40.157445 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:49:40.157386    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35e31966-01c3-4129-a86e-5c35923a2f64" path="/var/lib/kubelet/pods/35e31966-01c3-4129-a86e-5c35923a2f64/volumes"
Nov 03 21:50:01.398200 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:50:01.398159    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:50:31.397656 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:50:31.397578    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:51:01.397070 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:51:01.397033    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:51:31.397397 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:51:31.397348    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:51:34.010267 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:51:34.010234    6774 scope.go:122] "RemoveContainer" containerID="b330255d37715e4e0042457afcd8b7ec5449bb828f0576fb9f6cf61dbe085015"
Nov 03 21:52:01.025318 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:52:01.025281    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"]
Nov 03 21:52:01.037923 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:52:01.037888    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b02f255-xhjvh"]
Nov 03 21:52:01.401607 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:52:01.401550    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:52:02.180986 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:52:02.180948    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc8b719a-8603-4626-b6a1-b026d00297e0" path="/var/lib/kubelet/pods/bc8b719a-8603-4626-b6a1-b026d00297e0/volumes"
Nov 03 21:52:31.396852 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:52:31.396815    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:52:34.025723 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:52:34.025688    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"]
Nov 03 21:52:34.039882 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:52:34.039844    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-72df3e8f-827l8"]
Nov 03 21:52:34.158067 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:52:34.158032    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="08f6d7cc-6c48-4782-899e-08ebf18bb20f" path="/var/lib/kubelet/pods/08f6d7cc-6c48-4782-899e-08ebf18bb20f/volumes"
Nov 03 21:53:01.404852 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:53:01.404805    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:53:03.032118 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:03.032085    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"]
Nov 03 21:53:03.047557 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:03.047522    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a24d85e3-dkc78"]
Nov 03 21:53:04.157279 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:04.157243    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be2442bc-38e8-4480-8343-54145dd6265a" path="/var/lib/kubelet/pods/be2442bc-38e8-4480-8343-54145dd6265a/volumes"
Nov 03 21:53:08.037336 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:08.037257    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"]
Nov 03 21:53:08.050468 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:08.050438    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c0a06a41-t9qfc"]
Nov 03 21:53:08.158106 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:08.158074    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9eb2c331-29ef-4cb6-b42a-e20cfed79499" path="/var/lib/kubelet/pods/9eb2c331-29ef-4cb6-b42a-e20cfed79499/volumes"
Nov 03 21:53:10.024091 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:10.024053    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"]
Nov 03 21:53:10.036978 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:10.036944    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bba538ea-cmsnx"]
Nov 03 21:53:10.157528 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:10.157496    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a808086-8284-4a58-8292-7af94d6b86fe" path="/var/lib/kubelet/pods/4a808086-8284-4a58-8292-7af94d6b86fe/volumes"
Nov 03 21:53:24.219599 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:24.219560    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 21:53:24.220031 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:24.219639    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:53:24.273546 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:24.273504    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 21:53:24.273847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:24.273813    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:53:31.397462 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:53:31.397409    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:53:34.040591 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:34.040560    6774 scope.go:122] "RemoveContainer" containerID="c1fdeaf6852bd65362b2e49f400236721b17c2c7fc3f8f6bc47438a4fbf34a04"
Nov 03 21:53:34.049171 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:34.049143    6774 scope.go:122] "RemoveContainer" containerID="4d41f8fffaa59c911aa368bfd8815a6be5d61d803b22e234865fefe99121a8db"
Nov 03 21:53:58.030285 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.030249    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"]
Nov 03 21:53:58.030804 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.030464    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn" podUID="07098bf5-33d1-4d10-ad29-06a6703394f3" containerName="discovery" containerID="cri-o://d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295" gracePeriod=30
Nov 03 21:53:58.045047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.045013    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"]
Nov 03 21:53:58.045174 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.045067    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1c40cee1-6qvvs"]
Nov 03 21:53:58.157920 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.157889    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5514e96e-108b-4759-9084-ef75147ad928" path="/var/lib/kubelet/pods/5514e96e-108b-4759-9084-ef75147ad928/volumes"
Nov 03 21:53:58.282816 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.282755    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:53:58.336323 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.336295    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.336514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.336360    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.336514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.336400    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.336514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.336448    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.336514 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.336507    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.336945 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.336918    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 21:53:58.339071 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.339042    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:53:58.339163 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.339094    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:53:58.339528 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.339504    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:53:58.342528 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.342505    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:53:58.359489 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.359455    6774 generic.go:356] "Generic (PLEG): container finished" podID="07098bf5-33d1-4d10-ad29-06a6703394f3" containerID="d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295" exitCode=0
Nov 03 21:53:58.359622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.359512    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"
Nov 03 21:53:58.359622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.359532    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn" event={"ID":"07098bf5-33d1-4d10-ad29-06a6703394f3","Type":"ContainerDied","Data":"d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295"}
Nov 03 21:53:58.359622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.359582    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn" event={"ID":"07098bf5-33d1-4d10-ad29-06a6703394f3","Type":"ContainerDied","Data":"87a5862bb7db25240bb9c9f3d63387407d6769ae2532094b030e108e23311270"}
Nov 03 21:53:58.359622 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.359602    6774 scope.go:122] "RemoveContainer" containerID="d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295"
Nov 03 21:53:58.368847 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.368824    6774 scope.go:122] "RemoveContainer" containerID="d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295"
Nov 03 21:53:58.369134 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:53:58.369113    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295\": container with ID starting with d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295 not found: ID does not exist" containerID="d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295"
Nov 03 21:53:58.369199 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.369142    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295"} err="failed to get container status \"d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295\": rpc error: code = NotFound desc = could not find container \"d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295\": container with ID starting with d7673e6fe6c3c18c37bed2817cf1cbfb9faa64df29ac3f9be2b204b8a9d48295 not found: ID does not exist"
Nov 03 21:53:58.437664 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.437625    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.437897 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.437849    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp\") pod \"07098bf5-33d1-4d10-ad29-06a6703394f3\" (UID: \"07098bf5-33d1-4d10-ad29-06a6703394f3\") "
Nov 03 21:53:58.438219 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.438192    6774 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-ca-configmap\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.438219 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.438212    6774 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-cacerts\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.438219 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.438224    6774 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-csr-dns-cert\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.438469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.438239    6774 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-kubeconfig\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.438469 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.438252    6774 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07098bf5-33d1-4d10-ad29-06a6703394f3-local-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.439854 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.439829    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:53:58.439942 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.439861    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp" pod "07098bf5-33d1-4d10-ad29-06a6703394f3" (UID: "07098bf5-33d1-4d10-ad29-06a6703394f3"). InnerVolumeSpecName "kube-api-access-lrsrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:53:58.539558 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.539468    6774 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-istio-token\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.539558 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.539501    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrsrp\" (UniqueName: \"kubernetes.io/projected/07098bf5-33d1-4d10-ad29-06a6703394f3-kube-api-access-lrsrp\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:53:58.706744 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.706706    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"]
Nov 03 21:53:58.720167 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:53:58.720124    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-k2sqn"]
Nov 03 21:54:00.157812 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:54:00.157777    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07098bf5-33d1-4d10-ad29-06a6703394f3" path="/var/lib/kubelet/pods/07098bf5-33d1-4d10-ad29-06a6703394f3/volumes"
Nov 03 21:54:01.397691 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:54:01.397648    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:54:31.396279 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:54:31.396243    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:54:34.073303 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:54:34.073199    6774 scope.go:122] "RemoveContainer" containerID="24d1469613670c82cfda6109de6899fb2cd81b3d7fd23d54837a3dadcd06456f"
Nov 03 21:54:34.081960 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:54:34.081939    6774 scope.go:122] "RemoveContainer" containerID="444382e468909f1b6f10de71cf57b96a596da71aaebf638b4b5dbe74bd6ea3c2"
Nov 03 21:54:34.089455 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:54:34.089435    6774 scope.go:122] "RemoveContainer" containerID="c9790cafde616f94dd536fb7dd7f2c1230956f4fcca8b00a07e21aada63a72b3"
Nov 03 21:54:34.096815 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:54:34.096778    6774 scope.go:122] "RemoveContainer" containerID="75390f443ffd554dd7b3071e0961a38083dc6848eb9d67022fb67de66c4273fe"
Nov 03 21:54:34.104169 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:54:34.104151    6774 scope.go:122] "RemoveContainer" containerID="db136d4886c9c35636285ec0a8265af52be09a64a84aea718db3b8c3f1a85565"
Nov 03 21:55:01.398990 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:55:01.398941    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:55:31.397137 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:55:31.397100    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:55:34.141730 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:34.141696    6774 scope.go:122] "RemoveContainer" containerID="7380f95c92a9cbebc7929b81e26d3e64abadd1ea952e299bd0c20bafe87aea05"
Nov 03 21:55:59.564289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564251    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"]
Nov 03 21:55:59.564844 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564824    6774 cpu_manager.go:414] "containerMap: removing container" podUID="07098bf5-33d1-4d10-ad29-06a6703394f3" containerName="discovery"
Nov 03 21:55:59.564901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564848    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07098bf5-33d1-4d10-ad29-06a6703394f3" containerName="discovery"
Nov 03 21:55:59.564901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564878    6774 cpu_manager.go:414] "containerMap: removing container" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerName="payload-processing"
Nov 03 21:55:59.564901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564886    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerName="payload-processing"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564906    6774 cpu_manager.go:414] "containerMap: removing container" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564914    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564934    6774 cpu_manager.go:414] "containerMap: removing container" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564940    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564957    6774 cpu_manager.go:414] "containerMap: removing container" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564965    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564985    6774 cpu_manager.go:414] "containerMap: removing container" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.564992    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy"
Nov 03 21:55:59.565008 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565007    6774 cpu_manager.go:414] "containerMap: removing container" podUID="5514e96e-108b-4759-9084-ef75147ad928" containerName="revoke-keys"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565015    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5514e96e-108b-4759-9084-ef75147ad928" containerName="revoke-keys"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565105    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="2a4dcc05-fefc-4f94-8505-841d9d38ec19" containerName="payload-processing"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565115    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="5514e96e-108b-4759-9084-ef75147ad928" containerName="revoke-keys"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565126    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6c1cf21-5efd-423c-969f-623ba164d70e" containerName="istio-proxy"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565138    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd1869b1-e189-4c4a-96e9-19e7719acbb2" containerName="istio-proxy"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565146    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="07098bf5-33d1-4d10-ad29-06a6703394f3" containerName="discovery"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565159    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0b0f9f4-5f32-4285-ae8c-d22eb0f1519d" containerName="main"
Nov 03 21:55:59.565289 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.565173    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="8dc2cda4-4240-400b-bd7b-d444909c9bce" containerName="istio-proxy"
Nov 03 21:55:59.568802 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.568781    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.589311 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.589270    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"]
Nov 03 21:55:59.597302 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.597269    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-9f9b50\"/\"kube-root-ca.crt\""
Nov 03 21:55:59.597454 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.597331    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-9f9b50\"/\"openshift-service-ca.crt\""
Nov 03 21:55:59.598199 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.598172    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-9f9b50\"/\"default-dockercfg-6gtl5\""
Nov 03 21:55:59.598199 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.598181    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-9f9b50\"/\"simulator-single-main-9f9b50-kserve-self-signed-certs\""
Nov 03 21:55:59.705826 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.705788    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.706035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.705850    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.706035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.705964    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.706035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.705995    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m89fp\" (UniqueName: \"kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.706035 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.706032    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.706269 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.706167    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.806944 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.806907    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.806953    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.806994    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.807027    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.807053    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m89fp\" (UniqueName: \"kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.807084    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807548 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.807527    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807676 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.807563    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.807737 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.807723    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.809518 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.809495    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.809901 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.809881    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.829202 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.829146    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m89fp\" (UniqueName: \"kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp\") pod \"simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") " pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:55:59.887630 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:55:59.887588    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:56:00.180545 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:00.180511    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"]
Nov 03 21:56:00.183379 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:56:00.183357    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b7298d7_e5bc_4c0a_81d0_fa8f0417d011.slice/crio-77545869ddc0cdfdf90f46e86048680d68edb973d1977173590da4a4249c4b57 WatchSource:0}: Error finding container 77545869ddc0cdfdf90f46e86048680d68edb973d1977173590da4a4249c4b57: Status 404 returned error can't find the container with id 77545869ddc0cdfdf90f46e86048680d68edb973d1977173590da4a4249c4b57
Nov 03 21:56:01.041089 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:01.041048    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8" event={"ID":"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011","Type":"ContainerStarted","Data":"269e705ee68dabbc9fde55e05992797d23a1597c26e39874209956592188d13e"}
Nov 03 21:56:01.041089 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:01.041104    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8" event={"ID":"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011","Type":"ContainerStarted","Data":"77545869ddc0cdfdf90f46e86048680d68edb973d1977173590da4a4249c4b57"}
Nov 03 21:56:01.085123 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:01.085066    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8" podStartSLOduration=2.085051842 podStartE2EDuration="2.085051842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:56:01.079757194 +0000 UTC m=+1531.046593927" watchObservedRunningTime="2026-11-03 21:56:01.085051842 +0000 UTC m=+1531.051888579"
Nov 03 21:56:01.396908 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:56:01.396871    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:56:01.888518 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:01.888483    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:56:09.888246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:09.888164    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:56:09.900677 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:09.900654    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:56:10.094750 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:10.094719    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:56:31.397528 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:56:31.397486    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:56:47.144092 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:56:47.144059    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"]
Nov 03 21:57:01.397394 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:57:01.397353    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:57:02.163932 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.163879    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8" podUID="2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" containerName="main" containerID="cri-o://269e705ee68dabbc9fde55e05992797d23a1597c26e39874209956592188d13e" gracePeriod=45
Nov 03 21:57:02.332792 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.332762    6774 generic.go:356] "Generic (PLEG): container finished" podID="2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" containerID="269e705ee68dabbc9fde55e05992797d23a1597c26e39874209956592188d13e" exitCode=0
Nov 03 21:57:02.332946 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.332838    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8" event={"ID":"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011","Type":"ContainerDied","Data":"269e705ee68dabbc9fde55e05992797d23a1597c26e39874209956592188d13e"}
Nov 03 21:57:02.420023 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.419963    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:57:02.536545 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536512    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp\" (UniqueName: \"kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp\") pod \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") "
Nov 03 21:57:02.536709 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536605    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home\") pod \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") "
Nov 03 21:57:02.536709 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536658    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir\") pod \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") "
Nov 03 21:57:02.536789 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536730    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache\") pod \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") "
Nov 03 21:57:02.536789 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536753    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs\") pod \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") "
Nov 03 21:57:02.536891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536790    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm\") pod \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\" (UID: \"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011\") "
Nov 03 21:57:02.536891 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536822    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home" pod "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" (UID: "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:57:02.537002 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536918    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir" pod "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" (UID: "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:57:02.537059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.536996    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache" pod "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" (UID: "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:57:02.537159 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.537142    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:57:02.537225 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.537162    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:57:02.537225 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.537175    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:57:02.538822 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.538794    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm" pod "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" (UID: "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 21:57:02.538952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.538862    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs" pod "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" (UID: "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 21:57:02.538952 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.538878    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp" pod "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" (UID: "2b7298d7-e5bc-4c0a-81d0-fa8f0417d011"). InnerVolumeSpecName "kube-api-access-m89fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 21:57:02.638626 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.638569    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:57:02.638626 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.638620    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:57:02.638626 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:02.638633    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m89fp\" (UniqueName: \"kubernetes.io/projected/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011-kube-api-access-m89fp\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 21:57:03.339043 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:03.339013    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"
Nov 03 21:57:03.339246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:03.339014    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8" event={"ID":"2b7298d7-e5bc-4c0a-81d0-fa8f0417d011","Type":"ContainerDied","Data":"77545869ddc0cdfdf90f46e86048680d68edb973d1977173590da4a4249c4b57"}
Nov 03 21:57:03.339246 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:03.339131    6774 scope.go:122] "RemoveContainer" containerID="269e705ee68dabbc9fde55e05992797d23a1597c26e39874209956592188d13e"
Nov 03 21:57:03.391210 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:03.391175    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"]
Nov 03 21:57:03.404213 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:03.404180    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-9f9b50/simulator-single-main-9f9b50-kserve-6cd7b8d887-4b6k8"]
Nov 03 21:57:04.157205 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:04.157174    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" path="/var/lib/kubelet/pods/2b7298d7-e5bc-4c0a-81d0-fa8f0417d011/volumes"
Nov 03 21:57:16.097646 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:16.097605    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-lcs5b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 21:57:16.098317 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:57:16.098278    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-lcs5b" podUID="d4f3f780-1c36-4f45-bdc0-04a985131f32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 21:57:31.397011 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:57:31.396971    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:58:01.397934 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:58:01.397891    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:58:31.397650 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:58:31.397610    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:59:01.397636 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:59:01.397586    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:59:31.396730 ip-10-0-142-174 kubenswrapper[6774]: E1103 21:59:31.396692    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 21:59:54.831006 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.830970    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"]
Nov 03 21:59:54.831482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.831337    6774 cpu_manager.go:414] "containerMap: removing container" podUID="2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" containerName="main"
Nov 03 21:59:54.831482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.831349    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" containerName="main"
Nov 03 21:59:54.831482 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.831440    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b7298d7-e5bc-4c0a-81d0-fa8f0417d011" containerName="main"
Nov 03 21:59:54.834207 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.834182    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:54.853078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.853049    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"]
Nov 03 21:59:54.864749 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.864709    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-3503c0\"/\"openshift-service-ca.crt\""
Nov 03 21:59:54.864951 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.864776    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-3503c0\"/\"kube-root-ca.crt\""
Nov 03 21:59:54.864951 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.864934    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-3503c0\"/\"simulator-single-main-3503c0-kserve-self-signed-certs\""
Nov 03 21:59:54.865938 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.865923    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-3503c0\"/\"default-dockercfg-nzfct\""
Nov 03 21:59:54.979798 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.979762    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:54.980078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.979814    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:54.980078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.979834    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:54.980078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.979965    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:54.980078 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.980007    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:54.980245 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:54.980125    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck27c\" (UniqueName: \"kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.080970    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081022    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081059 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081038    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081066    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081087    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081346 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081118    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck27c\" (UniqueName: \"kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081582 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081531    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081701 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081579    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.081701 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.081613    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.083276 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.083250    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.083587 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.083571    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.101270 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.101242    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck27c\" (UniqueName: \"kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c\") pod \"simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") " pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.148969 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.148938    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 21:59:55.443930 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:55.443894    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"]
Nov 03 21:59:55.446161 ip-10-0-142-174 kubenswrapper[6774]: W1103 21:59:55.446135    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbde1ed4a_0827_48c8_acbf_40a9b87d2088.slice/crio-cb464c9d5b9a520deabc922eba811cb6a84333d4f184bb57912e71a689790c9e WatchSource:0}: Error finding container cb464c9d5b9a520deabc922eba811cb6a84333d4f184bb57912e71a689790c9e: Status 404 returned error can't find the container with id cb464c9d5b9a520deabc922eba811cb6a84333d4f184bb57912e71a689790c9e
Nov 03 21:59:56.246183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:56.246146    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx" event={"ID":"bde1ed4a-0827-48c8-acbf-40a9b87d2088","Type":"ContainerStarted","Data":"42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc"}
Nov 03 21:59:56.246183 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:56.246186    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx" event={"ID":"bde1ed4a-0827-48c8-acbf-40a9b87d2088","Type":"ContainerStarted","Data":"cb464c9d5b9a520deabc922eba811cb6a84333d4f184bb57912e71a689790c9e"}
Nov 03 21:59:56.290545 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:56.290486    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx" podStartSLOduration=2.2904674050000002 podStartE2EDuration="2.290467405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 21:59:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 21:59:56.288496868 +0000 UTC m=+1766.255333604" watchObservedRunningTime="2026-11-03 21:59:56.290467405 +0000 UTC m=+1766.257304137"
Nov 03 21:59:57.150047 ip-10-0-142-174 kubenswrapper[6774]: I1103 21:59:57.150014    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 22:00:00.139414 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.139372    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"]
Nov 03 22:00:00.143049 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.143021    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.160777 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.160746    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 22:00:00.160777 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.160764    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 22:00:00.174354 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.174316    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p4zs2\""
Nov 03 22:00:00.175864 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.175835    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"]
Nov 03 22:00:00.224704 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.224669    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dstk\" (UniqueName: \"kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk\") pod \"maas-api-key-cleanup-29895720-h7ffg\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.224910 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.224718    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895720-h7ffg\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.325985 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.325946    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895720-h7ffg\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.326173 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.326082    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dstk\" (UniqueName: \"kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk\") pod \"maas-api-key-cleanup-29895720-h7ffg\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.326666 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.326645    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895720-h7ffg\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.345962 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.345928    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dstk\" (UniqueName: \"kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk\") pod \"maas-api-key-cleanup-29895720-h7ffg\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.456170 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.456081    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:00.752938 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:00.752896    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"]
Nov 03 22:00:00.755468 ip-10-0-142-174 kubenswrapper[6774]: W1103 22:00:00.755438    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545bcb9c_7b2f_43a6_b8a4_c53d47525033.slice/crio-0070460ae32aa8ade83f6fa2254c527d07be3fac2b87c9f5e0e6a5659a84b226 WatchSource:0}: Error finding container 0070460ae32aa8ade83f6fa2254c527d07be3fac2b87c9f5e0e6a5659a84b226: Status 404 returned error can't find the container with id 0070460ae32aa8ade83f6fa2254c527d07be3fac2b87c9f5e0e6a5659a84b226
Nov 03 22:00:01.272078 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:01.272038    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" event={"ID":"545bcb9c-7b2f-43a6-b8a4-c53d47525033","Type":"ContainerStarted","Data":"3c4f3ad7b9f1fdf1c2c29f392bc25bee8bb2653d9e921c13bfeb2a8960726839"}
Nov 03 22:00:01.272550 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:01.272100    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" event={"ID":"545bcb9c-7b2f-43a6-b8a4-c53d47525033","Type":"ContainerStarted","Data":"0070460ae32aa8ade83f6fa2254c527d07be3fac2b87c9f5e0e6a5659a84b226"}
Nov 03 22:00:01.314598 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:01.314483    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" podStartSLOduration=1.31446914 podStartE2EDuration="1.31446914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:00:01.312921451 +0000 UTC m=+1771.279758188" watchObservedRunningTime="2026-11-03 22:00:01.31446914 +0000 UTC m=+1771.281305920"
Nov 03 22:00:01.398981 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:00:01.398942    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:00:02.278618 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:02.278582    6774 generic.go:356] "Generic (PLEG): container finished" podID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerID="3c4f3ad7b9f1fdf1c2c29f392bc25bee8bb2653d9e921c13bfeb2a8960726839" exitCode=60
Nov 03 22:00:02.279031 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:02.278642    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" event={"ID":"545bcb9c-7b2f-43a6-b8a4-c53d47525033","Type":"ContainerDied","Data":"3c4f3ad7b9f1fdf1c2c29f392bc25bee8bb2653d9e921c13bfeb2a8960726839"}
Nov 03 22:00:02.279031 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:02.278909    6774 scope.go:122] "RemoveContainer" containerID="3c4f3ad7b9f1fdf1c2c29f392bc25bee8bb2653d9e921c13bfeb2a8960726839"
Nov 03 22:00:03.285990 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:03.285955    6774 generic.go:356] "Generic (PLEG): container finished" podID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerID="333a976c4a0d9f15b96f630c307c1f8ae8837031770ff01501f2046c33d51149" exitCode=60
Nov 03 22:00:03.286489 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:03.286032    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" event={"ID":"545bcb9c-7b2f-43a6-b8a4-c53d47525033","Type":"ContainerDied","Data":"333a976c4a0d9f15b96f630c307c1f8ae8837031770ff01501f2046c33d51149"}
Nov 03 22:00:03.286489 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:03.286113    6774 scope.go:122] "RemoveContainer" containerID="3c4f3ad7b9f1fdf1c2c29f392bc25bee8bb2653d9e921c13bfeb2a8960726839"
Nov 03 22:00:03.286489 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:03.286398    6774 scope.go:122] "RemoveContainer" containerID="333a976c4a0d9f15b96f630c307c1f8ae8837031770ff01501f2046c33d51149"
Nov 03 22:00:03.286714 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:00:03.286695    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895720-h7ffg_odh-ai-gateway-infra(545bcb9c-7b2f-43a6-b8a4-c53d47525033)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033"
Nov 03 22:00:04.293546 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:04.293515    6774 scope.go:122] "RemoveContainer" containerID="333a976c4a0d9f15b96f630c307c1f8ae8837031770ff01501f2046c33d51149"
Nov 03 22:00:04.293957 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:00:04.293787    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895720-h7ffg_odh-ai-gateway-infra(545bcb9c-7b2f-43a6-b8a4-c53d47525033)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033"
Nov 03 22:00:05.149442 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:05.149381    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 22:00:05.161725 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:05.161693    6774 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 22:00:05.309812 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:05.309780    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 22:00:15.152331 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:15.152300    6774 scope.go:122] "RemoveContainer" containerID="333a976c4a0d9f15b96f630c307c1f8ae8837031770ff01501f2046c33d51149"
Nov 03 22:00:16.352587 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:16.352553    6774 generic.go:356] "Generic (PLEG): container finished" podID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerID="7e7d93b4201d167977bcc9841456dc99939aa106deeafcafc2f90b03191b07d4" exitCode=60
Nov 03 22:00:16.353005 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:16.352626    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" event={"ID":"545bcb9c-7b2f-43a6-b8a4-c53d47525033","Type":"ContainerDied","Data":"7e7d93b4201d167977bcc9841456dc99939aa106deeafcafc2f90b03191b07d4"}
Nov 03 22:00:16.353005 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:16.352688    6774 scope.go:122] "RemoveContainer" containerID="333a976c4a0d9f15b96f630c307c1f8ae8837031770ff01501f2046c33d51149"
Nov 03 22:00:16.353126 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:16.353004    6774 scope.go:122] "RemoveContainer" containerID="7e7d93b4201d167977bcc9841456dc99939aa106deeafcafc2f90b03191b07d4"
Nov 03 22:00:16.353252 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:00:16.353230    6774 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895720-h7ffg_odh-ai-gateway-infra(545bcb9c-7b2f-43a6-b8a4-c53d47525033)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033"
Nov 03 22:00:17.399869 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.399834    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"]
Nov 03 22:00:17.535233 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.535203    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:17.590575 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.590543    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca\") pod \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") "
Nov 03 22:00:17.590740 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.590609    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk\" (UniqueName: \"kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk\") pod \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\" (UID: \"545bcb9c-7b2f-43a6-b8a4-c53d47525033\") "
Nov 03 22:00:17.590920 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.590895    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca" pod "545bcb9c-7b2f-43a6-b8a4-c53d47525033" (UID: "545bcb9c-7b2f-43a6-b8a4-c53d47525033"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:00:17.592660 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.592633    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk" pod "545bcb9c-7b2f-43a6-b8a4-c53d47525033" (UID: "545bcb9c-7b2f-43a6-b8a4-c53d47525033"). InnerVolumeSpecName "kube-api-access-9dstk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:17.692169 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.692081    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545bcb9c-7b2f-43a6-b8a4-c53d47525033-maas-api-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:17.692169 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:17.692113    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dstk\" (UniqueName: \"kubernetes.io/projected/545bcb9c-7b2f-43a6-b8a4-c53d47525033-kube-api-access-9dstk\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:18.366154 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:18.366122    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"
Nov 03 22:00:18.366321 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:18.366150    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg" event={"ID":"545bcb9c-7b2f-43a6-b8a4-c53d47525033","Type":"ContainerDied","Data":"0070460ae32aa8ade83f6fa2254c527d07be3fac2b87c9f5e0e6a5659a84b226"}
Nov 03 22:00:18.366321 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:18.366212    6774 scope.go:122] "RemoveContainer" containerID="7e7d93b4201d167977bcc9841456dc99939aa106deeafcafc2f90b03191b07d4"
Nov 03 22:00:18.417280 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:18.417203    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"]
Nov 03 22:00:18.430606 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:18.430579    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895720-h7ffg"]
Nov 03 22:00:20.158857 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:20.158826    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" path="/var/lib/kubelet/pods/545bcb9c-7b2f-43a6-b8a4-c53d47525033/volumes"
Nov 03 22:00:31.397153 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:00:31.397116    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:00:40.930949 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:40.930859    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"]
Nov 03 22:00:55.951050 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:55.950998    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx" podUID="bde1ed4a-0827-48c8-acbf-40a9b87d2088" containerName="main" containerID="cri-o://42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc" gracePeriod=45
Nov 03 22:00:56.202301 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.202243    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 22:00:56.262544 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262510    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm\") pod \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") "
Nov 03 22:00:56.262730 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262558    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache\") pod \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") "
Nov 03 22:00:56.262730 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262595    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir\") pod \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") "
Nov 03 22:00:56.262730 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262612    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home\") pod \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") "
Nov 03 22:00:56.262730 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262642    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs\" (UniqueName: \"kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs\") pod \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") "
Nov 03 22:00:56.262946 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262915    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir" pod "bde1ed4a-0827-48c8-acbf-40a9b87d2088" (UID: "bde1ed4a-0827-48c8-acbf-40a9b87d2088"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:56.263048 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262991    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home" pod "bde1ed4a-0827-48c8-acbf-40a9b87d2088" (UID: "bde1ed4a-0827-48c8-acbf-40a9b87d2088"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:56.263048 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262760    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c\" (UniqueName: \"kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c\") pod \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\" (UID: \"bde1ed4a-0827-48c8-acbf-40a9b87d2088\") "
Nov 03 22:00:56.263259 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.262947    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache" pod "bde1ed4a-0827-48c8-acbf-40a9b87d2088" (UID: "bde1ed4a-0827-48c8-acbf-40a9b87d2088"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:56.263518 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.263494    6774 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-model-cache\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:56.263722 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.263698    6774 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tmp-dir\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:56.263840 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.263724    6774 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-home\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:56.264966 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.264944    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs" pod "bde1ed4a-0827-48c8-acbf-40a9b87d2088" (UID: "bde1ed4a-0827-48c8-acbf-40a9b87d2088"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:00:56.265115 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.265100    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm" pod "bde1ed4a-0827-48c8-acbf-40a9b87d2088" (UID: "bde1ed4a-0827-48c8-acbf-40a9b87d2088"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 03 22:00:56.265220 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.265200    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c" pod "bde1ed4a-0827-48c8-acbf-40a9b87d2088" (UID: "bde1ed4a-0827-48c8-acbf-40a9b87d2088"). InnerVolumeSpecName "kube-api-access-ck27c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:00:56.364531 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.364497    6774 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bde1ed4a-0827-48c8-acbf-40a9b87d2088-dshm\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:56.364531 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.364528    6774 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bde1ed4a-0827-48c8-acbf-40a9b87d2088-tls-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:56.364531 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.364539    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck27c\" (UniqueName: \"kubernetes.io/projected/bde1ed4a-0827-48c8-acbf-40a9b87d2088-kube-api-access-ck27c\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:00:56.550118 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.550039    6774 generic.go:356] "Generic (PLEG): container finished" podID="bde1ed4a-0827-48c8-acbf-40a9b87d2088" containerID="42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc" exitCode=0
Nov 03 22:00:56.550118 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.550085    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"
Nov 03 22:00:56.550118 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.550109    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx" event={"ID":"bde1ed4a-0827-48c8-acbf-40a9b87d2088","Type":"ContainerDied","Data":"42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc"}
Nov 03 22:00:56.550348 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.550141    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx" event={"ID":"bde1ed4a-0827-48c8-acbf-40a9b87d2088","Type":"ContainerDied","Data":"cb464c9d5b9a520deabc922eba811cb6a84333d4f184bb57912e71a689790c9e"}
Nov 03 22:00:56.550348 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.550158    6774 scope.go:122] "RemoveContainer" containerID="42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc"
Nov 03 22:00:56.559886 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.559863    6774 scope.go:122] "RemoveContainer" containerID="42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc"
Nov 03 22:00:56.560155 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:00:56.560129    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc\": container with ID starting with 42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc not found: ID does not exist" containerID="42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc"
Nov 03 22:00:56.560229 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.560167    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc"} err="failed to get container status \"42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc\": rpc error: code = NotFound desc = could not find container \"42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc\": container with ID starting with 42a604c092bb42c7597a7fdf068f6dfb49345627c8ffdf9765291302492b33bc not found: ID does not exist"
Nov 03 22:00:56.603626 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.603589    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"]
Nov 03 22:00:56.606722 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:56.606691    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-3503c0/simulator-single-main-3503c0-kserve-6cdf787c68-nf6sx"]
Nov 03 22:00:58.157736 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:00:58.157695    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bde1ed4a-0827-48c8-acbf-40a9b87d2088" path="/var/lib/kubelet/pods/bde1ed4a-0827-48c8-acbf-40a9b87d2088/volumes"
Nov 03 22:01:01.397609 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:01:01.397574    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:01:31.397745 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:01:31.397700    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:01:39.223624 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:01:39.223578    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-zt4t7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:01:39.224120 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:01:39.223640    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-zt4t7" podUID="d7ce2554-a321-4503-ac13-dbbb1085f3a6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:01:39.258557 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:01:39.258519    6774 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-75d7c785f-f49qd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 03 22:01:39.258839 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:01:39.258803    6774 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-75d7c785f-f49qd" podUID="2772e952-a407-4c76-babc-20f3bca31802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 03 22:02:01.398209 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:02:01.398170    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:02:31.398602 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:02:31.398520    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:02:41.639653 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.639615    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"]
Nov 03 22:02:41.640057 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640007    6774 cpu_manager.go:414] "containerMap: removing container" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:41.640057 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640020    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:41.640057 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640045    6774 cpu_manager.go:414] "containerMap: removing container" podUID="bde1ed4a-0827-48c8-acbf-40a9b87d2088" containerName="main"
Nov 03 22:02:41.640057 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640049    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bde1ed4a-0827-48c8-acbf-40a9b87d2088" containerName="main"
Nov 03 22:02:41.640191 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640066    6774 cpu_manager.go:414] "containerMap: removing container" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:41.640191 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640072    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:41.640191 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640139    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:41.640191 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640147    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:41.640191 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.640154    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="bde1ed4a-0827-48c8-acbf-40a9b87d2088" containerName="main"
Nov 03 22:02:41.643348 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.643325    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.662382 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.662338    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"]
Nov 03 22:02:41.674106 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.674073    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 03 22:02:41.676891 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.676868    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bl9fk\""
Nov 03 22:02:41.677087 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.677054    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 03 22:02:41.677087 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.677055    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 03 22:02:41.677258 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.677126    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 03 22:02:41.741379 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.741344    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.741379 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.741381    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.741623 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.741401    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbxc\" (UniqueName: \"kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.741679 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.741647    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.842619 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.842579    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.842787 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.842631    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.842787 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.842655    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.842787 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.842684    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbxc\" (UniqueName: \"kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.843351 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.843317    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.845280 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.845255    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.845378 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.845262    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.861915 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.861890    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbxc\" (UniqueName: \"kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc\") pod \"maas-api-7458978ff4-4djcb\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") " pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:41.956849 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:41.956754    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:42.263379 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:42.263349    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"]
Nov 03 22:02:42.265566 ip-10-0-142-174 kubenswrapper[6774]: W1103 22:02:42.265541    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cab389f_a6ea_4459_a10d_9b71199cd5f2.slice/crio-38b93ed8702f2f412aa2c790abd79d830aa86d392fdb90fb9504a928f133ce36 WatchSource:0}: Error finding container 38b93ed8702f2f412aa2c790abd79d830aa86d392fdb90fb9504a928f133ce36: Status 404 returned error can't find the container with id 38b93ed8702f2f412aa2c790abd79d830aa86d392fdb90fb9504a928f133ce36
Nov 03 22:02:42.266840 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:42.266820    6774 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 03 22:02:43.179757 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:43.179716    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb" event={"ID":"8cab389f-a6ea-4459-a10d-9b71199cd5f2","Type":"ContainerStarted","Data":"efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f"}
Nov 03 22:02:43.180194 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:43.179777    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb" event={"ID":"8cab389f-a6ea-4459-a10d-9b71199cd5f2","Type":"ContainerStarted","Data":"38b93ed8702f2f412aa2c790abd79d830aa86d392fdb90fb9504a928f133ce36"}
Nov 03 22:02:43.180194 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:43.179850    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:43.220437 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:43.220356    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb" podStartSLOduration=1.840828929 podStartE2EDuration="2.220339819s" totalImagesPullingTime="379.51089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:02:43.220132658 +0000 UTC m=+1933.186969395" watchObservedRunningTime="2026-11-03 22:02:43.220339819 +0000 UTC m=+1933.187176556"
Nov 03 22:02:48.955290 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.955247    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"]
Nov 03 22:02:48.955852 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.955467    6774 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb" podUID="8cab389f-a6ea-4459-a10d-9b71199cd5f2" containerName="maas-api" containerID="cri-o://efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f" gracePeriod=30
Nov 03 22:02:48.961047 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.961021    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:48.985218 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.985190    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"]
Nov 03 22:02:48.985606 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.985592    6774 cpu_manager.go:414] "containerMap: removing container" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:48.985694 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.985608    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:48.985755 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.985697    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="545bcb9c-7b2f-43a6-b8a4-c53d47525033" containerName="cleanup"
Nov 03 22:02:48.988753 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:48.988734    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.008249 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.008210    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"]
Nov 03 22:02:49.010770 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.010740    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077cc7b3-12ce-4520-bc8a-3479ae34f49e-maas-api-tls\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.010906 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.010867    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077cc7b3-12ce-4520-bc8a-3479ae34f49e-openshift-service-ca\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.010996 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.010975    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rrjg\" (UniqueName: \"kubernetes.io/projected/077cc7b3-12ce-4520-bc8a-3479ae34f49e-kube-api-access-2rrjg\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.011064 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.011021    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077cc7b3-12ce-4520-bc8a-3479ae34f49e-metrics-certs\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.112211 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.112167    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077cc7b3-12ce-4520-bc8a-3479ae34f49e-maas-api-tls\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.112396 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.112316    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077cc7b3-12ce-4520-bc8a-3479ae34f49e-openshift-service-ca\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.112396 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.112391    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rrjg\" (UniqueName: \"kubernetes.io/projected/077cc7b3-12ce-4520-bc8a-3479ae34f49e-kube-api-access-2rrjg\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.112544 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.112434    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077cc7b3-12ce-4520-bc8a-3479ae34f49e-metrics-certs\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.112994 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.112965    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/077cc7b3-12ce-4520-bc8a-3479ae34f49e-openshift-service-ca\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.114642 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.114614    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/077cc7b3-12ce-4520-bc8a-3479ae34f49e-maas-api-tls\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.114728 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.114707    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/077cc7b3-12ce-4520-bc8a-3479ae34f49e-metrics-certs\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.132999 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.132969    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rrjg\" (UniqueName: \"kubernetes.io/projected/077cc7b3-12ce-4520-bc8a-3479ae34f49e-kube-api-access-2rrjg\") pod \"maas-api-cb9fbb88b-jhpwk\" (UID: \"077cc7b3-12ce-4520-bc8a-3479ae34f49e\") " pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.203609 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.203585    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:49.207989 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.207926    6774 generic.go:356] "Generic (PLEG): container finished" podID="8cab389f-a6ea-4459-a10d-9b71199cd5f2" containerID="efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f" exitCode=0
Nov 03 22:02:49.207989 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.207973    6774 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"
Nov 03 22:02:49.208122 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.208001    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb" event={"ID":"8cab389f-a6ea-4459-a10d-9b71199cd5f2","Type":"ContainerDied","Data":"efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f"}
Nov 03 22:02:49.208122 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.208054    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7458978ff4-4djcb" event={"ID":"8cab389f-a6ea-4459-a10d-9b71199cd5f2","Type":"ContainerDied","Data":"38b93ed8702f2f412aa2c790abd79d830aa86d392fdb90fb9504a928f133ce36"}
Nov 03 22:02:49.208122 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.208076    6774 scope.go:122] "RemoveContainer" containerID="efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f"
Nov 03 22:02:49.216296 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.216279    6774 scope.go:122] "RemoveContainer" containerID="efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f"
Nov 03 22:02:49.216551 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:02:49.216530    6774 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f\": container with ID starting with efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f not found: ID does not exist" containerID="efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f"
Nov 03 22:02:49.216619 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.216560    6774 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f"} err="failed to get container status \"efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f\": rpc error: code = NotFound desc = could not find container \"efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f\": container with ID starting with efbfeeb3835891d5b0d4bb42f5901e4b78e6d3571012f5caffa90f3cf532686f not found: ID does not exist"
Nov 03 22:02:49.313915 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.313878    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc\" (UniqueName: \"kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc\") pod \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") "
Nov 03 22:02:49.313915 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.313916    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca\") pod \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") "
Nov 03 22:02:49.314176 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.313938    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs\") pod \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") "
Nov 03 22:02:49.314176 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.313977    6774 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls\") pod \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\" (UID: \"8cab389f-a6ea-4459-a10d-9b71199cd5f2\") "
Nov 03 22:02:49.314555 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.314287    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca" pod "8cab389f-a6ea-4459-a10d-9b71199cd5f2" (UID: "8cab389f-a6ea-4459-a10d-9b71199cd5f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 03 22:02:49.316104 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.316084    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls" pod "8cab389f-a6ea-4459-a10d-9b71199cd5f2" (UID: "8cab389f-a6ea-4459-a10d-9b71199cd5f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:02:49.316178 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.316109    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc" pod "8cab389f-a6ea-4459-a10d-9b71199cd5f2" (UID: "8cab389f-a6ea-4459-a10d-9b71199cd5f2"). InnerVolumeSpecName "kube-api-access-mmbxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 03 22:02:49.316178 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.316125    6774 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs" pod "8cab389f-a6ea-4459-a10d-9b71199cd5f2" (UID: "8cab389f-a6ea-4459-a10d-9b71199cd5f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 03 22:02:49.354346 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.354311    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:49.415408 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.415305    6774 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmbxc\" (UniqueName: \"kubernetes.io/projected/8cab389f-a6ea-4459-a10d-9b71199cd5f2-kube-api-access-mmbxc\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:02:49.415408 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.415343    6774 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cab389f-a6ea-4459-a10d-9b71199cd5f2-openshift-service-ca\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:02:49.415408 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.415360    6774 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-metrics-certs\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:02:49.415408 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.415373    6774 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cab389f-a6ea-4459-a10d-9b71199cd5f2-maas-api-tls\") on node \"ip-10-0-142-174.ec2.internal\" DevicePath \"\""
Nov 03 22:02:49.554023 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.553987    6774 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"]
Nov 03 22:02:49.558236 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.558208    6774 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7458978ff4-4djcb"]
Nov 03 22:02:49.659277 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:49.659252    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"]
Nov 03 22:02:49.661645 ip-10-0-142-174 kubenswrapper[6774]: W1103 22:02:49.661609    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077cc7b3_12ce_4520_bc8a_3479ae34f49e.slice/crio-2457fc5b0f0a6f327ae6a9021e8e84a17edca66eef2f62e42153756b91951049 WatchSource:0}: Error finding container 2457fc5b0f0a6f327ae6a9021e8e84a17edca66eef2f62e42153756b91951049: Status 404 returned error can't find the container with id 2457fc5b0f0a6f327ae6a9021e8e84a17edca66eef2f62e42153756b91951049
Nov 03 22:02:50.157857 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:50.157825    6774 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8cab389f-a6ea-4459-a10d-9b71199cd5f2" path="/var/lib/kubelet/pods/8cab389f-a6ea-4459-a10d-9b71199cd5f2/volumes"
Nov 03 22:02:50.215086 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:50.215048    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk" event={"ID":"077cc7b3-12ce-4520-bc8a-3479ae34f49e","Type":"ContainerStarted","Data":"8ba754904a06df13598262ba0aee6955eac50a04364ce3812f500cdfb24ca544"}
Nov 03 22:02:50.215271 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:50.215108    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk" event={"ID":"077cc7b3-12ce-4520-bc8a-3479ae34f49e","Type":"ContainerStarted","Data":"2457fc5b0f0a6f327ae6a9021e8e84a17edca66eef2f62e42153756b91951049"}
Nov 03 22:02:50.215271 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:50.215161    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:02:50.254938 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:50.254836    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk" podStartSLOduration=1.9513972210000001 podStartE2EDuration="2.254821169s" totalImagesPullingTime="303.423948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:02:50.254383548 +0000 UTC m=+1940.221220283" watchObservedRunningTime="2026-11-03 22:02:50.254821169 +0000 UTC m=+1940.221657903"
Nov 03 22:02:56.229357 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:02:56.229323    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-cb9fbb88b-jhpwk"
Nov 03 22:03:01.397406 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:03:01.397363    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:03:31.396593 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:03:31.396546    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:04:01.397726 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:04:01.397681    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:04:31.397104 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:04:31.397065    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:05:01.397093 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:05:01.397054    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:05:31.397443 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:05:31.397341    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:06:01.397374 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:06:01.397339    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:06:31.397385 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:06:31.397341    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:06:47.547606 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:06:47.547575    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-xd5q8_5d69a1a7-c95d-474a-9a47-b1178c34d7ef/manager/0.log"
Nov 03 22:06:49.350401 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:06:49.350373    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-cb9fbb88b-jhpwk_077cc7b3-12ce-4520-bc8a-3479ae34f49e/maas-api/0.log"
Nov 03 22:07:01.397021 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:07:01.396974    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:07:12.688846 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:12.688811    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kvkcj_8725e8dd-b62b-419c-bc7a-1d00064b90e3/kuadrant-console-plugin/0.log"
Nov 03 22:07:14.708840 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:14.708809    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5554b6f8-x5m6g_125ee10d-14b2-45cb-82cd-f52babe26bf9/kube-auth-proxy/0.log"
Nov 03 22:07:25.303058 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:25.303014    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-f49qd_2772e952-a407-4c76-babc-20f3bca31802/istio-proxy/0.log"
Nov 03 22:07:25.517322 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:25.517291    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-lcs5b_d4f3f780-1c36-4f45-bdc0-04a985131f32/istio-proxy/0.log"
Nov 03 22:07:26.723903 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:26.723873    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-zt4t7_d7ce2554-a321-4503-ac13-dbbb1085f3a6/istio-proxy/0.log"
Nov 03 22:07:31.397775 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:07:31.397736    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:07:40.430869 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:40.430837    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-xd5q8_5d69a1a7-c95d-474a-9a47-b1178c34d7ef/manager/0.log"
Nov 03 22:07:42.045631 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:42.045595    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-cb9fbb88b-jhpwk_077cc7b3-12ce-4520-bc8a-3479ae34f49e/maas-api/0.log"
Nov 03 22:07:55.664585 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:55.664554    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kvkcj_8725e8dd-b62b-419c-bc7a-1d00064b90e3/kuadrant-console-plugin/0.log"
Nov 03 22:07:57.421909 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:57.421876    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5554b6f8-x5m6g_125ee10d-14b2-45cb-82cd-f52babe26bf9/kube-auth-proxy/0.log"
Nov 03 22:07:58.014777 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:58.014732    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-f49qd_2772e952-a407-4c76-babc-20f3bca31802/istio-proxy/0.log"
Nov 03 22:07:58.212030 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:58.211991    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-lcs5b_d4f3f780-1c36-4f45-bdc0-04a985131f32/istio-proxy/0.log"
Nov 03 22:07:59.365381 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:07:59.365352    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-zt4t7_d7ce2554-a321-4503-ac13-dbbb1085f3a6/istio-proxy/0.log"
Nov 03 22:08:01.397279 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:08:01.397238    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:08:31.397251 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:08:31.397142    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:09:01.396808 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:09:01.396768    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:09:31.397832 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:09:31.397790    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:10:01.397499 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:10:01.397457    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:10:31.397933 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:10:31.397889    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:10:59.575919 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:10:59.575891    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fwwbw_1f036244-f039-410c-9580-d75499fbe5c6/global-pull-secret-syncer/0.log"
Nov 03 22:11:00.640766 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:00.640738    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hmlfq_03a303b3-2834-490f-8835-b62c1f14e058/konnectivity-agent/0.log"
Nov 03 22:11:01.141245 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:01.141215    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-174.ec2.internal_f4e271960909dbae93ddf03ac1216c26/haproxy/0.log"
Nov 03 22:11:01.397651 ip-10-0-142-174 kubenswrapper[6774]: E1103 22:11:01.397565    6774 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dm87h" containerName="extractor"
Nov 03 22:11:08.168207 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:08.168126    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kvkcj_8725e8dd-b62b-419c-bc7a-1d00064b90e3/kuadrant-console-plugin/0.log"
Nov 03 22:11:09.616583 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.616550    6774 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"]
Nov 03 22:11:09.616971 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.616935    6774 cpu_manager.go:414] "containerMap: removing container" podUID="8cab389f-a6ea-4459-a10d-9b71199cd5f2" containerName="maas-api"
Nov 03 22:11:09.616971 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.616945    6774 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8cab389f-a6ea-4459-a10d-9b71199cd5f2" containerName="maas-api"
Nov 03 22:11:09.617048 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.617009    6774 memory_manager.go:365] "RemoveStaleState removing state" podUID="8cab389f-a6ea-4459-a10d-9b71199cd5f2" containerName="maas-api"
Nov 03 22:11:09.620241 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.620222    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.636733 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.636706    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"]
Nov 03 22:11:09.648229 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.648200    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sl2kc\"/\"kube-root-ca.crt\""
Nov 03 22:11:09.648366 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.648274    6774 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sl2kc\"/\"openshift-service-ca.crt\""
Nov 03 22:11:09.661077 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.661055    6774 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sl2kc\"/\"default-dockercfg-8mbwx\""
Nov 03 22:11:09.777339 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.777303    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-podres\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.777339 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.777341    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-lib-modules\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.777556 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.777505    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-proc\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.777625 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.777571    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw4jh\" (UniqueName: \"kubernetes.io/projected/342919c0-f05a-47ad-bfcc-0725491006dd-kube-api-access-tw4jh\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.777667 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.777624    6774 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-sys\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.813547 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.813515    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/alertmanager/0.log"
Nov 03 22:11:09.878598 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878512    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-proc\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878598 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878589    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw4jh\" (UniqueName: \"kubernetes.io/projected/342919c0-f05a-47ad-bfcc-0725491006dd-kube-api-access-tw4jh\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878819 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878619    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-sys\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878819 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878635    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-proc\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878819 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878649    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-podres\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878819 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878715    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-podres\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878819 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878717    6774 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-lib-modules\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.878819 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878769    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-lib-modules\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.879006 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.878721    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342919c0-f05a-47ad-bfcc-0725491006dd-sys\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.898412 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.898382    6774 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw4jh\" (UniqueName: \"kubernetes.io/projected/342919c0-f05a-47ad-bfcc-0725491006dd-kube-api-access-tw4jh\") pod \"perf-node-gather-daemonset-jjs6r\" (UID: \"342919c0-f05a-47ad-bfcc-0725491006dd\") " pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:09.925219 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.925192    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/config-reloader/0.log"
Nov 03 22:11:09.932246 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:09.932223    6774 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:10.040614 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.040582    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/kube-rbac-proxy-web/0.log"
Nov 03 22:11:10.161368 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.161279    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/kube-rbac-proxy/0.log"
Nov 03 22:11:10.236577 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.236547    6774 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"]
Nov 03 22:11:10.239613 ip-10-0-142-174 kubenswrapper[6774]: W1103 22:11:10.239574    6774 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod342919c0_f05a_47ad_bfcc_0725491006dd.slice/crio-1675e507072c0b05591fb18e77b46e60564e4cea0dcf48e4f648c204a605579e WatchSource:0}: Error finding container 1675e507072c0b05591fb18e77b46e60564e4cea0dcf48e4f648c204a605579e: Status 404 returned error can't find the container with id 1675e507072c0b05591fb18e77b46e60564e4cea0dcf48e4f648c204a605579e
Nov 03 22:11:10.271395 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.271349    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/kube-rbac-proxy-metric/0.log"
Nov 03 22:11:10.381890 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.381866    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/prom-label-proxy/0.log"
Nov 03 22:11:10.493756 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.493680    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11edbdba-555c-4733-b719-df6d8140e8a7/init-config-reloader/0.log"
Nov 03 22:11:10.610085 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.610042    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r" event={"ID":"342919c0-f05a-47ad-bfcc-0725491006dd","Type":"ContainerStarted","Data":"8f1668baa40b840ce04b13cc4f58018bbb54e6026c5fe0d025a4f47796a5a533"}
Nov 03 22:11:10.610279 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.610097    6774 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r" event={"ID":"342919c0-f05a-47ad-bfcc-0725491006dd","Type":"ContainerStarted","Data":"1675e507072c0b05591fb18e77b46e60564e4cea0dcf48e4f648c204a605579e"}
Nov 03 22:11:10.610279 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.610180    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:10.649983 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:10.649933    6774 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r" podStartSLOduration=1.6499203310000001 podStartE2EDuration="1.649920331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:11:10.648711166 +0000 UTC m=+2440.615547894" watchObservedRunningTime="2026-11-03 22:11:10.649920331 +0000 UTC m=+2440.616757084"
Nov 03 22:11:11.081330 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:11.081300    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-94f499b94-rbvsp_fee08312-111b-48d2-923b-b5b5ea20260c/metrics-server/0.log"
Nov 03 22:11:11.337936 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:11.337854    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4zmzr_7b489156-3ebf-4f7f-b5c5-8fe4999ed900/node-exporter/0.log"
Nov 03 22:11:11.447467 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:11.447378    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4zmzr_7b489156-3ebf-4f7f-b5c5-8fe4999ed900/kube-rbac-proxy/0.log"
Nov 03 22:11:11.557946 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:11.557922    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4zmzr_7b489156-3ebf-4f7f-b5c5-8fe4999ed900/init-textfile/0.log"
Nov 03 22:11:12.731172 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:12.731136    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/prometheus/0.log"
Nov 03 22:11:12.841625 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:12.841588    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/config-reloader/0.log"
Nov 03 22:11:12.951076 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:12.951046    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/thanos-sidecar/0.log"
Nov 03 22:11:13.062969 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:13.062889    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/kube-rbac-proxy-web/0.log"
Nov 03 22:11:13.173514 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:13.173489    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/kube-rbac-proxy/0.log"
Nov 03 22:11:13.283399 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:13.283372    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/kube-rbac-proxy-thanos/0.log"
Nov 03 22:11:13.396332 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:13.396308    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1c40eff3-9bee-4747-8f55-f8c6d450cd63/init-config-reloader/0.log"
Nov 03 22:11:13.515048 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:13.515018    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-dlw9p_4584a052-9e3d-4daf-b707-e4a584abcb74/prometheus-operator/0.log"
Nov 03 22:11:13.622317 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:13.622272    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-dlw9p_4584a052-9e3d-4daf-b707-e4a584abcb74/kube-rbac-proxy/0.log"
Nov 03 22:11:14.225989 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:14.225955    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dff68f85f-d46qq_82ddd449-8baa-4a8c-a505-ede3ef9abeea/thanos-query/0.log"
Nov 03 22:11:14.338508 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:14.338477    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dff68f85f-d46qq_82ddd449-8baa-4a8c-a505-ede3ef9abeea/kube-rbac-proxy-web/0.log"
Nov 03 22:11:14.451654 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:14.451627    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dff68f85f-d46qq_82ddd449-8baa-4a8c-a505-ede3ef9abeea/kube-rbac-proxy/0.log"
Nov 03 22:11:14.561772 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:14.561702    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dff68f85f-d46qq_82ddd449-8baa-4a8c-a505-ede3ef9abeea/prom-label-proxy/0.log"
Nov 03 22:11:14.672286 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:14.672261    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dff68f85f-d46qq_82ddd449-8baa-4a8c-a505-ede3ef9abeea/kube-rbac-proxy-rules/0.log"
Nov 03 22:11:14.781396 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:14.781355    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5dff68f85f-d46qq_82ddd449-8baa-4a8c-a505-ede3ef9abeea/kube-rbac-proxy-metrics/0.log"
Nov 03 22:11:16.624363 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:16.624331    6774 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sl2kc/perf-node-gather-daemonset-jjs6r"
Nov 03 22:11:18.051636 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:18.051610    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-697898cdb4-ghpsn_13cc6919-3d3a-4722-84f6-bdc7df3b96f5/console/0.log"
Nov 03 22:11:18.171617 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:18.171589    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-ptcfx_4f883755-74f9-491d-97ac-98ec31061ea6/download-server/0.log"
Nov 03 22:11:21.427839 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:21.427813    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5kdw4_243453a2-1472-4e79-8ff4-d2f1671f6139/dns/0.log"
Nov 03 22:11:21.536269 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:21.536216    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5kdw4_243453a2-1472-4e79-8ff4-d2f1671f6139/kube-rbac-proxy/0.log"
Nov 03 22:11:22.363951 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:22.363926    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vd6hh_104d10b5-1122-4387-90ee-317e6cbed43f/dns-node-resolver/0.log"
Nov 03 22:11:23.815172 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:23.815140    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c6h7b_1435ae86-9aeb-453a-b45f-1f490d891e59/node-ca/0.log"
Nov 03 22:11:24.556527 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:24.556498    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b5554b6f8-x5m6g_125ee10d-14b2-45cb-82cd-f52babe26bf9/kube-auth-proxy/0.log"
Nov 03 22:11:24.728759 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:24.728729    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-f49qd_2772e952-a407-4c76-babc-20f3bca31802/istio-proxy/0.log"
Nov 03 22:11:24.786107 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:24.786076    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-lcs5b_d4f3f780-1c36-4f45-bdc0-04a985131f32/istio-proxy/0.log"
Nov 03 22:11:25.231997 ip-10-0-142-174 kubenswrapper[6774]: I1103 22:11:25.231965    6774 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-75d7c785f-zt4t7_d7ce2554-a321-4503-ac13-dbbb1085f3a6/istio-proxy/0.log"