Oct 31 00:11:10.255013 ip-10-0-140-47 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 31 00:11:10.255027 ip-10-0-140-47 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 31 00:11:10.255036 ip-10-0-140-47 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 31 00:11:10.255376 ip-10-0-140-47 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 31 00:11:20.295992 ip-10-0-140-47 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 31 00:11:20.296013 ip-10-0-140-47 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot af774ea2fe6e41ff98a4c1491720f78d --
Oct 31 00:13:42.329764 ip-10-0-140-47 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 00:13:42.741852 ip-10-0-140-47 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:13:42.741852 ip-10-0-140-47 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 00:13:42.741852 ip-10-0-140-47 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:13:42.741852 ip-10-0-140-47 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:13:42.746138 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746058    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.746138 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746139    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746145    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746149    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746153    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746156    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746159    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746162    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746165    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746169    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746171    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746174    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746177    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746179    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746182    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746184    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746187    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746189    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746192    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746195    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.746209 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746203    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746206    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746209    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746212    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746215    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746218    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746221    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746223    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746226    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746229    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746231    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746234    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746236    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746239    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746242    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746245    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746248    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746250    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746253    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746255    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.746679 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746258    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746260    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746262    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746265    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746268    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746272    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746276    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746278    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746281    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746284    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746287    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746289    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746292    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746295    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746298    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746302    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746304    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746307    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746310    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.747149 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746312    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746315    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746317    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746320    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746323    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746325    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746328    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746330    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746333    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746335    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746338    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746341    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746344    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746347    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746350    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746353    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746355    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746358    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746360    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746363    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.747619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746365    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746368    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746371    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746373    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746375    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746378    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746381    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746384    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746387    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746389    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746392    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746395    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746397    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746400    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746402    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746405    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746407    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746422    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746425    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746427    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.748103 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746430    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746433    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746437    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746440    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746442    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746445    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.746448    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747239    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747246    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747248    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747251    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747254    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747257    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747260    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747262    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747265    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747268    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747270    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747273    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747276    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.748588 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747279    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747281    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747284    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747287    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747289    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747292    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747295    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747298    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747301    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747304    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747306    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747308    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747311    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747314    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747317    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747320    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747322    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747325    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747327    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747331    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.749118 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747334    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747336    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747339    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747341    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747344    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747346    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747349    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747351    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747354    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747356    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747359    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747362    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747365    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747369    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747373    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747376    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747379    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747381    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747388    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.749617 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747392    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747395    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747398    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747400    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747403    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747406    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747409    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747426    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747429    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747432    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747435    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747437    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747440    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747443    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747446    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747448    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747451    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747453    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747456    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.750066 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747459    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747461    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747464    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747466    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747469    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747472    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747474    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747477    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747480    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747482    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747485    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747488    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747492    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747494    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747497    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747499    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747502    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747505    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747507    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747510    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.750521 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747512    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747515    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747518    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747520    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747523    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747525    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747528    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747531    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747534    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747537    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747539    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747542    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747545    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747548    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.747550    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748091    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748097    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748101    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748104    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748107    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.751013 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748109    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748112    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748115    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748118    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748121    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748124    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748127    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748129    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748132    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748135    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748138    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748140    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748143    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748145    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748148    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748151    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748153    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748156    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748158    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748166    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.751520 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748170    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748172    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748175    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748178    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748180    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748183    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748185    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748188    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748193    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748196    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748199    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748202    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748204    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748207    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748209    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748212    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748214    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748217    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.751998 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748221    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748225    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748228    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748231    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748233    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748236    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748239    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748241    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748244    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748246    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748249    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748251    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748254    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748256    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748264    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748267    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748270    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748272    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748275    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.752438 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748278    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748281    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748284    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748288    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748291    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748293    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748296    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748299    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748302    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748304    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748307    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748309    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748313    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748316    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748319    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748322    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748324    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748327    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748330    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748332    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.752891 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748335    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748337    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748339    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748342    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748345    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748347    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748349    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748352    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748360    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748363    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748365    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748368    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748371    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748373    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748376    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748381    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748385    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748387    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748390    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748392    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.753363 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748395    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748398    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748401    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.748403    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749257    2586 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749271    2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749282    2586 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749287    2586 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749291    2586 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749295    2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749299    2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749303    2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749306    2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749310    2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749313    2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749316    2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749320    2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749323    2586 flags.go:64] FLAG: --cgroup-root=""
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749326    2586 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749329    2586 flags.go:64] FLAG: --client-ca-file=""
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749332    2586 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749341    2586 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749347    2586 flags.go:64] FLAG: --cluster-domain=""
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749350    2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 00:13:42.753879 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749353    2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749356    2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749361    2586 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749366    2586 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749371    2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749374    2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749377    2586 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749380    2586 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749383    2586 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749386    2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749390    2586 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749393    2586 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749397    2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749400    2586 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749403    2586 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749406    2586 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749409    2586 flags.go:64] FLAG: --enable-server="true"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749424    2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749432    2586 flags.go:64] FLAG: --event-burst="100"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749435    2586 flags.go:64] FLAG: --event-qps="50"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749438    2586 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749441    2586 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749445    2586 flags.go:64] FLAG: --eviction-hard=""
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749449    2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 00:13:42.754444 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749452    2586 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749456    2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749459    2586 flags.go:64] FLAG: --eviction-soft=""
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749462    2586 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749465    2586 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749468    2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749476    2586 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749480    2586 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749482    2586 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749485    2586 flags.go:64] FLAG: --feature-gates=""
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749489    2586 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749493    2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749498    2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749501    2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749504    2586 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749508    2586 flags.go:64] FLAG: --help="false"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749510    2586 flags.go:64] FLAG: --hostname-override="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749514    2586 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749517    2586 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749520    2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749523    2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749526    2586 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749529    2586 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 00:13:42.755037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749532    2586 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749535    2586 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749538    2586 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749541    2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749544    2586 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749547    2586 flags.go:64] FLAG: --kube-reserved=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749550    2586 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749553    2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749556    2586 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749559    2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749561    2586 flags.go:64] FLAG: --lock-file=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749564    2586 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749567    2586 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749570    2586 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749576    2586 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749579    2586 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749587    2586 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749591    2586 flags.go:64] FLAG: --logging-format="text"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749594    2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749597    2586 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749600    2586 flags.go:64] FLAG: --manifest-url=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749604    2586 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749609    2586 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749612    2586 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749616    2586 flags.go:64] FLAG: --max-pods="110"
Oct 31 00:13:42.755791 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749619    2586 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749622    2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749625    2586 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749628    2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749631    2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749634    2586 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749637    2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749645    2586 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749648    2586 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749651    2586 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749655    2586 flags.go:64] FLAG: --pod-cidr=""
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749658    2586 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749661    2586 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749664    2586 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749667    2586 flags.go:64] FLAG: --port="10250"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749670    2586 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749673    2586 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-06c856e59653b3c7a"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749676    2586 flags.go:64] FLAG: --qos-reserved=""
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749679    2586 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749682    2586 flags.go:64] FLAG: --register-node="true"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749685    2586 flags.go:64] FLAG: --register-with-taints=""
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749689    2586 flags.go:64] FLAG: --registry-burst="10"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749691    2586 flags.go:64] FLAG: --registry-qps="5"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749694    2586 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749703    2586 flags.go:64] FLAG: --reserved-memory=""
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749708    2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 00:13:42.756866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749711    2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749714    2586 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749718    2586 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749721    2586 flags.go:64] FLAG: --runonce="false"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749724    2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749727    2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749730    2586 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749733    2586 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749736    2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749739    2586 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749742    2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749745    2586 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749748    2586 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749751    2586 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749754    2586 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749757    2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749760    2586 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749763    2586 flags.go:64] FLAG: --system-cgroups=""
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749765    2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749771    2586 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749774    2586 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749777    2586 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749783    2586 flags.go:64] FLAG: --tls-min-version=""
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749786    2586 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749794    2586 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 00:13:42.757962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749798    2586 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749800    2586 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749803    2586 flags.go:64] FLAG: --v="2"
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749807    2586 flags.go:64] FLAG: --version="false"
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749812    2586 flags.go:64] FLAG: --vmodule=""
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749818    2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.749828    2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750021    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750024    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750028    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750031    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750034    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750037    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750039    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750042    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750045    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750048    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750050    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750053    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750055    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750058    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.758994 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750060    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750063    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750065    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750068    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750071    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750074    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750077    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750079    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750082    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750084    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750087    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750090    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750092    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750094    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750097    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750100    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750104    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750106    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750115    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750118    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.759856 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750122    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750124    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750127    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750129    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750132    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750135    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750137    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750140    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750142    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750144    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750147    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750150    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750152    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750155    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750157    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750160    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750163    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750165    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750168    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750170    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.760733 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750172    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750176    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750180    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750182    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750185    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750187    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750190    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750192    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750196    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750199    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750202    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750210    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750214    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750217    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750219    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750222    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750224    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750227    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750229    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.761594 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750232    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750235    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750237    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750240    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750242    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750245    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750248    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750250    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750253    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750255    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750258    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750260    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750263    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750266    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750268    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750271    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750274    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750276    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750279    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.762406 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750282    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750284    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750289    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750292    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750296    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750299    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750311    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750314    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750317    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750319    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750322    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750325    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750327    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750330    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.750356    2586 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:13:42.763025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750431    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750436    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750439    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750442    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750445    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750448    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750450    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750453    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750455    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750458    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750461    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750463    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750466    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750469    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750471    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750474    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750476    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750479    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750481    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750484    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.763654 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750488    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750491    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750493    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750497    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750506    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750509    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750511    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750514    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750517    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750519    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750522    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750525    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750527    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750530    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750533    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750536    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750538    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750541    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750543    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.764495 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750546    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750549    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750551    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750554    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750556    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750559    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750561    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750564    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750568    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750575    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750577    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750580    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750583    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750587    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750596    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750598    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750602    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750604    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750612    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.764979 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750615    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750617    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750620    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750622    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750625    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750628    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750630    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750633    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750635    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750638    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750640    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750643    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750645    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750648    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750651    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750653    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750656    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750658    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750661    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750663    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.765592 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750666    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750669    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750671    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750674    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750676    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750679    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750683    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750685    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750688    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750691    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750695    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750699    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750710    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750713    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750716    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750719    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750722    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750724    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750727    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.766063 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750729    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750732    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750734    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750737    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750740    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750742    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750744    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750747    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.750749    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.760130    2586 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.760154    2586 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.760185    2586 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.760193    2586 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760291    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760299    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760304    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760309    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760316    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760323    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.766593 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760328    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760334    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760339    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760344    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760348    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760352    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760357    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760361    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760365    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760369    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760374    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760378    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760382    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760387    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760391    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760395    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760400    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760406    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760426    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.767121 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760432    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760436    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760441    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760446    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760452    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760456    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760461    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760465    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760470    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760474    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760478    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760482    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760487    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760491    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760495    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760499    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760503    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760508    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760513    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760517    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.767626 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760521    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760525    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760530    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760534    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760538    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760542    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760547    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760551    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760555    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760559    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760563    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760568    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760573    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760577    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760581    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760585    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760591    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760596    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760600    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760604    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.768463 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760608    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760613    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760617    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760621    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760626    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760630    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760635    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760639    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760643    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760647    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760651    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760656    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760660    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760664    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760678    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760682    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760686    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760690    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760695    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760699    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.769263 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760704    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760709    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760713    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760717    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760721    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760726    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760729    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760734    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760739    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760743    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760747    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760751    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760755    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760760    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760764    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760769    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760773    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760778    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760782    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.770081 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760786    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.760791    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.760833    2586 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761101    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761108    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761112    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761116    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761121    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761133    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761138    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761142    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761146    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761151    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761155    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761159    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761164    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.770556 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761168    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761172    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761176    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761181    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761185    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761189    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761195    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761199    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761203    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761208    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761213    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761217    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761221    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761226    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761230    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761237    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761242    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761247    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761252    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.771025 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761256    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761261    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761265    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761269    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761273    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761278    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761289    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761294    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761298    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761303    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761307    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761312    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761317    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761321    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761326    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761332    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761337    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761341    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761345    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.771578 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761350    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761381    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761388    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761393    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761399    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761404    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761409    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761429    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761434    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761439    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761443    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761447    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761451    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761456    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761460    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761464    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761468    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761472    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761476    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761480    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.772028 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761493    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761497    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761501    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761505    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761512    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761516    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761521    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761525    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761530    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761534    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761538    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761543    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761547    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761551    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761555    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761560    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761565    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761569    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761573    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.772619 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761577    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761581    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761586    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761590    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761594    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761598    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761602    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761606    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761609    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761613    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761617    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761621    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761626    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761630    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761645    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761650    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.773083 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.761692    2586 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761754    2586 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761761    2586 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761766    2586 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761773    2586 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761778    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761783    2586 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761787    2586 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761791    2586 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761795    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761800    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761804    2586 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761808    2586 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761813    2586 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761817    2586 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761821    2586 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761825    2586 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761830    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761834    2586 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:13:42.773508 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761838    2586 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761842    2586 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761846    2586 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761851    2586 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761855    2586 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761859    2586 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761863    2586 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761867    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761871    2586 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761876    2586 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761880    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761884    2586 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761896    2586 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761900    2586 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761904    2586 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761909    2586 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761913    2586 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761918    2586 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761922    2586 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761926    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:13:42.773986 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761930    2586 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761934    2586 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761939    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761943    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761947    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761952    2586 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761956    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761960    2586 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761964    2586 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761968    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761972    2586 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761976    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761980    2586 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761985    2586 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761989    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761992    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.761997    2586 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762001    2586 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762006    2586 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:13:42.774609 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762010    2586 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762014    2586 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762018    2586 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762022    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762026    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762031    2586 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762044    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762049    2586 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762053    2586 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762057    2586 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762062    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762066    2586 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762070    2586 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762074    2586 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762078    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762083    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762087    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762092    2586 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762096    2586 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:13:42.775130 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762100    2586 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762104    2586 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762108    2586 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762112    2586 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762116    2586 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762121    2586 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762125    2586 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762130    2586 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762134    2586 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762138    2586 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762142    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762146    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762151    2586 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762155    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762159    2586 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762166    2586 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762173    2586 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762178    2586 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762182    2586 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:13:42.775635 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762186    2586 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762203    2586 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762208    2586 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762213    2586 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762217    2586 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762222    2586 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762226    2586 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762230    2586 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762235    2586 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762239    2586 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:42.762243    2586 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.762358    2586 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.765086    2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.766061    2586 server.go:1014] "Starting client certificate rotation"
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.766164    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.766200    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.768247    2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:13:42.776095 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.770020    2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:13:42.780966 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.780952    2586 log.go:25] "Validated CRI v1 runtime API"
Oct 31 00:13:42.783936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.783921    2586 log.go:25] "Validated CRI v1 image API"
Oct 31 00:13:42.784806 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.784784    2586 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 00:13:42.790232 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.790215    2586 fs.go:135] Filesystem UUIDs: map[19bea397-d12c-4855-8c30-33df1709958d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ab9533b9-0c7e-4712-80d1-2c6e77413809:/dev/nvme0n1p3]
Oct 31 00:13:42.790281 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.790232    2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 00:13:42.797115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.797000    2586 manager.go:217] Machine: {Timestamp:2026-10-31 00:13:42.794749839 +0000 UTC m=+0.346000496 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102592 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b67e0b3579e16975f418941330597 SystemUUID:ec2b67e0-b357-9e16-975f-418941330597 BootID:af774ea2-fe6e-41ff-98a4-c1491720f78d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:ef:e9:9b:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:ef:e9:9b:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:a4:aa:f2:ef:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 00:13:42.797573 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.797563    2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 00:13:42.797688 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.797676    2586 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 00:13:42.799449 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.799423    2586 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 00:13:42.799597 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.799451    2586 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-47.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 00:13:42.799645 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.799599    2586 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 00:13:42.799645 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.799608    2586 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 00:13:42.799645 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.799637    2586 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:13:42.799725 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.799655    2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:13:42.800400 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.800390    2586 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 00:13:42.803955 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.803943    2586 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 00:13:42.804078 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.804068    2586 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 00:13:42.804717 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.804708    2586 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 00:13:42.804755 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.804721    2586 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 00:13:42.804782 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.804760    2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 00:13:42.804782 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.804770    2586 kubelet.go:405] "Adding apiserver pod source"
Oct 31 00:13:42.804846 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.804777    2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 00:13:42.805295 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.805278    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:13:42.809872 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.809853    2586 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 00:13:42.813892 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.813877    2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:13:42.814784 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.814770    2586 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 00:13:42.814847 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.814810    2586 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 00:13:42.814999 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.814986    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 00:13:42.815065 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815007    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 00:13:42.815065 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815018    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 00:13:42.815065 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815028    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 00:13:42.815065 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815037    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 00:13:42.815065 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815046    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 00:13:42.815596 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815585    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 00:13:42.815656 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815600    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 00:13:42.815656 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815612    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 00:13:42.815656 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815623    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 00:13:42.815656 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815636    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 00:13:42.815656 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.815650    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 00:13:42.816914 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.816904    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 00:13:42.816966 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.816918    2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 00:13:42.820717 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.820702    2586 server.go:1263] "Started kubelet"
Oct 31 00:13:42.820876 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.820813    2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 00:13:42.820925 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.820814    2586 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 00:13:42.820925 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.820902    2586 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 00:13:42.821530 ip-10-0-140-47 systemd[1]: Started Kubernetes Kubelet.
Oct 31 00:13:42.822571 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.822547    2586 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 00:13:42.823337 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.823320    2586 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 00:13:42.826622 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.826604    2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.827068    2586 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:42.827368    2586 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-47.us-west-2.compute.internal\" not found"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.827717    2586 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.827734    2586 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.827810    2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.827919    2586 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 00:13:42.828025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.827927    2586 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 00:13:42.828380 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.828322    2586 factory.go:55] Registering systemd factory
Oct 31 00:13:42.828380 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.828338    2586 factory.go:223] Registration of the systemd container factory successfully
Oct 31 00:13:42.829896 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.829877    2586 factory.go:153] Registering CRI-O factory
Oct 31 00:13:42.829896 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.829897    2586 factory.go:223] Registration of the crio container factory successfully
Oct 31 00:13:42.830031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.829975    2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 00:13:42.830031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.829995    2586 factory.go:103] Registering Raw factory
Oct 31 00:13:42.830031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.830008    2586 manager.go:1199] Started watching for new ooms in manager
Oct 31 00:13:42.830292 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:42.830271    2586 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 00:13:42.830875 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.830863    2586 manager.go:319] Starting recovery of all containers
Oct 31 00:13:42.841514 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.841494    2586 manager.go:324] Recovery completed
Oct 31 00:13:42.847152 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.847134    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:42.849032 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849016    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:42.849118 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849048    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:42.849118 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849063    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:42.849710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849689    2586 cpu_manager.go:226] "Starting" policy="none"
Oct 31 00:13:42.849710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849697    2586 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 00:13:42.849783 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849713    2586 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 00:13:42.849857 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.849841    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:42.850632 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.850619    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:42.850703 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.850639    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:42.850703 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.850649    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:42.852182 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.852169    2586 policy_none.go:50] "Start"
Oct 31 00:13:42.852226 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.852185    2586 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 00:13:42.852226 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.852196    2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 00:13:42.854220 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.854210    2586 policy_none.go:44] "Start"
Oct 31 00:13:42.878993 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.878962    2586 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 00:13:42.881441 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.881409    2586 manager.go:341] "Starting Device Plugin manager"
Oct 31 00:13:42.881500 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:42.881474    2586 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 00:13:42.881500 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.881487    2586 server.go:87] "Starting device plugin registration server"
Oct 31 00:13:42.881737 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.881724    2586 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 00:13:42.881790 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.881767    2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 00:13:42.881916 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.881902    2586 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 00:13:42.882005 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.881989    2586 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 00:13:42.882005 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.882001    2586 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 00:13:42.882564 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:42.882545    2586 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 00:13:42.882640 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:42.882595    2586 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-47.us-west-2.compute.internal\" not found"
Oct 31 00:13:42.975753 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:42.974691    2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-47.us-west-2.compute.internal.18e374e97e6a2060  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-47.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-47.us-west-2.compute.internal,},FirstTimestamp:2026-10-31 00:13:42.82067568 +0000 UTC m=+0.371926336,LastTimestamp:2026-10-31 00:13:42.82067568 +0000 UTC m=+0.371926336,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-47.us-west-2.compute.internal,}"
Oct 31 00:13:42.982248 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.982233    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:42.983108 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.983090    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:42.983203 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.983122    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:42.983203 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.983137    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:42.983203 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:42.983169    2586 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.025093 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:43.024989    2586 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-47.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 31 00:13:43.025229 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.025115    2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-47.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 00:13:43.060014 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.048053    2586 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 00:13:43.060014 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.048100    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vxxmj"
Oct 31 00:13:43.086425 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.086382    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 00:13:43.087649 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.087632    2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 00:13:43.087734 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.087657    2586 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 00:13:43.087734 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.087680    2586 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 00:13:43.087734 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:43.087723    2586 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 00:13:43.125758 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.125731    2586 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:43.128716 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.128700    2586 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:43.188551 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.188515    2586 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"]
Oct 31 00:13:43.188712 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.188588    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:43.189587 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.189568    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:43.189681 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.189598    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:43.189681 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.189608    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:43.191506 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.191494    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:43.191645 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.191630    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.191685 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.191664    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:43.192251 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.192234    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:43.192332 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.192262    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:43.192332 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.192272    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:43.192332 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.192276    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:43.192332 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.192294    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:43.192332 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.192312    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:43.194018 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.194000    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.194104 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.194030    2586 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:13:43.195120 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.195101    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:13:43.195224 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.195141    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:13:43.195224 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.195158    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:13:43.218466 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.218289    2586 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:43.218647 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.218633    2586 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:43.219907 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.219892    2586 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.219988 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:43.219919    2586 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-47.us-west-2.compute.internal\": node \"ip-10-0-140-47.us-west-2.compute.internal\" not found"
Oct 31 00:13:43.228613 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.228593    2586 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.230889 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.230872    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.230975 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.230897    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.230975 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.230916    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd984434bab802ab7f7b4fe5c1c36bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"fd984434bab802ab7f7b4fe5c1c36bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.233504 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.233489    2586 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.235374 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.235361    2586 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.331657 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.331633    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.331812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.331664    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.331812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.331682    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd984434bab802ab7f7b4fe5c1c36bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"fd984434bab802ab7f7b4fe5c1c36bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.331812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.331751    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.331812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.331776    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd984434bab802ab7f7b4fe5c1c36bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"fd984434bab802ab7f7b4fe5c1c36bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.331812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.331751    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.356093 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.356062    2586 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:13:43.356344 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.356331    2586 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:13:43.356409 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.356398    2586 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.359240 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.359225    2586 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:13:43.359283 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:43.359264    2586 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.359839 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.359828    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.362898 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.362881    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.416693 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.416660    2586 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:13:43.416855 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:43.416715    2586 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:13:43.766502 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.766462    2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 00:13:43.767012 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.766614    2586 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:13:43.767012 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.766649    2586 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:13:43.767012 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.766655    2586 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:13:43.767012 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:43.766740    2586 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a076d63db167a4a51863954deecefa98-6bdc7d033aceb6e1.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-47.us-west-2.compute.internal.18e374e9801ad350\": read tcp 10.0.140.47:58548->3.132.154.107:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-47.us-west-2.compute.internal.18e374e9801ad350  default   4716 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-47.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-47.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-47.us-west-2.compute.internal,},FirstTimestamp:2026-10-31 00:13:42 +0000 UTC,LastTimestamp:2026-10-31 00:13:43.189584 +0000 UTC m=+0.740834658,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-47.us-west-2.compute.internal,}"
Oct 31 00:13:43.805377 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.805348    2586 apiserver.go:52] "Watching apiserver"
Oct 31 00:13:43.827765 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:43.827743    2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 00:13:44.054315 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.054236    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:08:42 +0000 UTC" deadline="2028-05-07 05:55:10.49031893 +0000 UTC"
Oct 31 00:13:44.054315 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.054266    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13301h41m26.436056265s"
Oct 31 00:13:44.060834 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.060821    2586 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 00:13:44.061104 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.061091    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal","openshift-network-operator/iptables-alerter-xtq8q","openshift-ovn-kubernetes/ovnkube-node-cq2q6","openshift-cluster-node-tuning-operator/tuned-89qld","openshift-multus/multus-additional-cni-plugins-nnpg6","openshift-multus/multus-zf867","openshift-multus/network-metrics-daemon-5725k","openshift-network-diagnostics/network-check-target-jxpcb","kube-system/global-pull-secret-syncer-65fz2","kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal","openshift-image-registry/node-ca-vxfn8","kube-system/konnectivity-agent-slhsd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6","openshift-dns/node-resolver-6cjm6"]
Oct 31 00:13:44.063236 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.063222    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.065057 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.065036    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.066795 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.066780    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.068518 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.068502    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.070371 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.070357    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.072297 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.072287    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.072348 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.072333    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:44.074233 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.074219    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:44.074298 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.074281    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:44.076154 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.076140    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.076211 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.076194    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:44.078041 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.078026    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.079975 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.079958    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.081987 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.081972    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.083875 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.083862    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.114732 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.114710    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfr46\""
Oct 31 00:13:44.117343 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.117323    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 00:13:44.117343 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.117323    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.129142 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.129122    2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 00:13:44.135897 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.135879    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-systemd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.135983 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.135902    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-kubernetes\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.135983 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.135918    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-system-cni-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.135983 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.135932    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-cnibin\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.135983 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.135946    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.136124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.135989    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136033    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a6dde53-407d-43ce-84df-30c1a1e08580-tmp-dir\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.136124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136065    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-socket-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.136124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136099    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-netns\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136118    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-env-overrides\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136132    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136148    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cnibin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136160    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-slash\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136189    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136216    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-multus-certs\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136243    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysconfig\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136273    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-etc-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136299 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136293    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136310    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-konnectivity-ca\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136344    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-registration-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136366    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136382    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-k8s-cni-cncf-io\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136399    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-bin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136443    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136463    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-agent-certs\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136477    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136493    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-run\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136515    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7ph\" (UniqueName: \"kubernetes.io/projected/6a6dde53-407d-43ce-84df-30c1a1e08580-kube-api-access-lf7ph\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.136549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136540    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136565    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136578    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr2f5\" (UniqueName: \"kubernetes.io/projected/462389b8-254c-4f99-ac14-5b66525f62dd-kube-api-access-qr2f5\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136602    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-942jl\" (UniqueName: \"kubernetes.io/projected/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-kube-api-access-942jl\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136617    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-system-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136630    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-netns\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136655    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9s7h\" (UniqueName: \"kubernetes.io/projected/46929db8-c3de-4e58-90e3-3099456b9018-kube-api-access-n9s7h\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136688    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-conf\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136730    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-var-lib-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136761    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-node-log\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136777    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkgkm\" (UniqueName: \"kubernetes.io/projected/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-kube-api-access-nkgkm\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136796    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-systemd\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136811    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cni-binary-copy\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136824    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136837    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-sys-fs\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.136913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136864    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-script-lib\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136955    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-tuned\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.136984    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-tmp\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137006    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137026    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-socket-dir-parent\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137039    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137051    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-dbus\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137068    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4205e63-79f8-4bda-861a-5402609c037f-host-slash\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137093    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-systemd-units\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137112    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-config\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137124    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkc48\" (UniqueName: \"kubernetes.io/projected/ae27e7a7-3d44-45dc-a232-4e85a5027a12-kube-api-access-mkc48\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137152    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137179    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-conf-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137196    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d998f53-1c5a-4144-880c-4c69c558ab97-host\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137216    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d998f53-1c5a-4144-880c-4c69c558ab97-serviceca\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137238    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ht4s\" (UniqueName: \"kubernetes.io/projected/7d998f53-1c5a-4144-880c-4c69c558ab97-kube-api-access-5ht4s\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.137280 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137254    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-netd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137272    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-lib-modules\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137292    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-kubelet\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137310    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-hostroot\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137328    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-daemon-config\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137362    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-device-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137391    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqp8\" (UniqueName: \"kubernetes.io/projected/d4205e63-79f8-4bda-861a-5402609c037f-kube-api-access-swqp8\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137423    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-log-socket\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137446    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovn-node-metrics-cert\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137474    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-host\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137488    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-kubelet\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137508    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-ovn\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137527    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-modprobe-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137543    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-sys\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137559    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9z2m\" (UniqueName: \"kubernetes.io/projected/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-kube-api-access-k9z2m\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137574    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4205e63-79f8-4bda-861a-5402609c037f-iptables-alerter-script\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137619    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a6dde53-407d-43ce-84df-30c1a1e08580-hosts-file\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.137700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137642    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-bin\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.138115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137658    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-etc-kubernetes\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.138115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137677    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-var-lib-kubelet\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.138115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137712    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-multus\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.138115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.137731    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-kubelet-config\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.203283 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.203261    2586 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 00:13:44.203388 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.203356    2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h8pmp"
Oct 31 00:13:44.206102 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206086    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 00:13:44.206197 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206183    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 00:13:44.206242 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206203    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ds5xr\""
Oct 31 00:13:44.206289 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206258    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 00:13:44.206289 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206259    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bvv2r\""
Oct 31 00:13:44.206289 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206283    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-bcxbn\""
Oct 31 00:13:44.206406 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206291    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h9nxs\""
Oct 31 00:13:44.206406 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206311    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v2pb4\""
Oct 31 00:13:44.206406 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206334    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7hvcc\""
Oct 31 00:13:44.206406 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206326    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-5jgbw\""
Oct 31 00:13:44.206406 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206336    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qdpqj\""
Oct 31 00:13:44.206963 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.206952    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 00:13:44.207011 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207000    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 00:13:44.207046 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207006    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.207046 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207021    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.207184 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207170    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.207232 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207197    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.207232 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207209    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 00:13:44.207232 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207172    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.207232 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207173    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.207232 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207229    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.207368 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207236    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 00:13:44.207368 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207237    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.207368 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207253    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.207368 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.207282    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.221937 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.221922    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 00:13:44.221937 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.221924    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 00:13:44.222055 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.222046    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.224666 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.224656    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 00:13:44.224715 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.224667    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 00:13:44.224715 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.224700    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 00:13:44.225161 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.225150    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 00:13:44.225161 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.225151    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 00:13:44.238755 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238737    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s7h\" (UniqueName: \"kubernetes.io/projected/46929db8-c3de-4e58-90e3-3099456b9018-kube-api-access-n9s7h\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.238817 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238759    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-conf\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.238817 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238774    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-var-lib-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.238817 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238792    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-node-log\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238815    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgkm\" (UniqueName: \"kubernetes.io/projected/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-kube-api-access-nkgkm\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238835    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-systemd\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238857    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-var-lib-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238872    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-node-log\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238891    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-systemd\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238909    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cni-binary-copy\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238908    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-conf\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.238936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238933    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238952    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-sys-fs\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238968    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-script-lib\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.238988    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-tuned\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239002    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-sys-fs\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239008    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-tmp\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239012    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239031    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239054    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-socket-dir-parent\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239076    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239095    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-dbus\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239116    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4205e63-79f8-4bda-861a-5402609c037f-host-slash\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239136    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-systemd-units\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239155    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-config\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239147    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-socket-dir-parent\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239176    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkc48\" (UniqueName: \"kubernetes.io/projected/ae27e7a7-3d44-45dc-a232-4e85a5027a12-kube-api-access-mkc48\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.239179    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239210    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:44.239314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239232    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-dbus\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239240    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-systemd-units\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.239238    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:44.739219232 +0000 UTC m=+2.290469893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239345    2586 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239471    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-conf-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239278    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-conf-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239773    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d998f53-1c5a-4144-880c-4c69c558ab97-host\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239798    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d998f53-1c5a-4144-880c-4c69c558ab97-serviceca\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239820    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ht4s\" (UniqueName: \"kubernetes.io/projected/7d998f53-1c5a-4144-880c-4c69c558ab97-kube-api-access-5ht4s\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239843    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-netd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239864    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-lib-modules\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239887    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-kubelet\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239907    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-hostroot\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239929    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-daemon-config\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239949    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-device-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239973    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqp8\" (UniqueName: \"kubernetes.io/projected/d4205e63-79f8-4bda-861a-5402609c037f-kube-api-access-swqp8\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239993    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-log-socket\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.239999    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240016    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovn-node-metrics-cert\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240041    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-host\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240044    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-config\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240062    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-kubelet\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240086    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-ovn\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240096    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-netd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240106    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-modprobe-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240138    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-sys\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240143    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-lib-modules\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240165    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9z2m\" (UniqueName: \"kubernetes.io/projected/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-kube-api-access-k9z2m\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240183    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-sys\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240188    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-modprobe-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240192    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4205e63-79f8-4bda-861a-5402609c037f-iptables-alerter-script\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240231    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d998f53-1c5a-4144-880c-4c69c558ab97-host\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240238    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-kubelet\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240044    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-script-lib\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240298    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-host\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.240860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240326    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cni-binary-copy\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240347    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-kubelet\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240386    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-device-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240388    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a6dde53-407d-43ce-84df-30c1a1e08580-hosts-file\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240434    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-bin\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240436    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-hostroot\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240500    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a6dde53-407d-43ce-84df-30c1a1e08580-hosts-file\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240559    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-bin\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240706    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-log-socket\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240722    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d998f53-1c5a-4144-880c-4c69c558ab97-serviceca\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240735    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4205e63-79f8-4bda-861a-5402609c037f-iptables-alerter-script\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240750    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-ovn\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240769    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-etc-kubernetes\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240795    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-var-lib-kubelet\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240815    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-multus\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240823    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4205e63-79f8-4bda-861a-5402609c037f-host-slash\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240824    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-daemon-config\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240851    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-etc-kubernetes\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.241572 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240865    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-multus\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240866    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-var-lib-kubelet\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240874    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-kubelet-config\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240903    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-systemd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240923    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-kubernetes\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240953    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-kubelet-config\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.240970    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-systemd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241010    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-system-cni-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241036    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-kubernetes\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241040    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-cnibin\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241060    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241077    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241084    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-system-cni-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241091    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a6dde53-407d-43ce-84df-30c1a1e08580-tmp-dir\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241098    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-cnibin\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241127    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-socket-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241161    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-netns\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242318 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241187    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-env-overrides\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241210    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241239    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cnibin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241262    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-slash\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241276    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-netns\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241282    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241238    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-socket-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241306    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-multus-certs\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241326    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysconfig\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241347    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-etc-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241347    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a6dde53-407d-43ce-84df-30c1a1e08580-tmp-dir\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241427    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241429    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241466    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241470    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cnibin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241493    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-konnectivity-ca\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241511    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.242777 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241518    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-registration-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241553    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-multus-certs\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241554    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241568    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-registration-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241599    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-slash\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241624    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241627    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241657    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-k8s-cni-cncf-io\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241678    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-bin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241691    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241702    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241725    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-k8s-cni-cncf-io\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241725    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-agent-certs\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241746    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-env-overrides\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241768    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241799    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-run\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241810    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-etc-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.243268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241823    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7ph\" (UniqueName: \"kubernetes.io/projected/6a6dde53-407d-43ce-84df-30c1a1e08580-kube-api-access-lf7ph\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241845    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysconfig\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241880    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241883    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-run\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241848    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241918    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241943    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr2f5\" (UniqueName: \"kubernetes.io/projected/462389b8-254c-4f99-ac14-5b66525f62dd-kube-api-access-qr2f5\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241966    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-942jl\" (UniqueName: \"kubernetes.io/projected/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-kube-api-access-942jl\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241973    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-bin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241986    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-system-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.242009    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-netns\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.242053    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.242063    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-netns\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.241943    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.242138    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:44.742121047 +0000 UTC m=+2.293371705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:44.243792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.242213    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-system-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.248923 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.248904    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-konnectivity-ca\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.249013 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.248937    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-tuned\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.249013 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.248964    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-tmp\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.249115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.249023    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovn-node-metrics-cert\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.249115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.249103    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-agent-certs\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.249189 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.249120    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.295597 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.295489    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:13:44.295597 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.295518    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:13:44.295597 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.295532    2586 projected.go:196] Error preparing data for projected volume kube-api-access-7sgxj for pod openshift-network-diagnostics/network-check-target-jxpcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:44.295882 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.295862    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj podName:e6e98896-64cd-4abd-94ef-a95f65f5d05d nodeName:}" failed. No retries permitted until 2026-10-31 00:13:44.795840603 +0000 UTC m=+2.347091264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7sgxj" (UniqueName: "kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj") pod "network-check-target-jxpcb" (UID: "e6e98896-64cd-4abd-94ef-a95f65f5d05d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:44.296382 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.296364    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgkm\" (UniqueName: \"kubernetes.io/projected/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-kube-api-access-nkgkm\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.296689 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.296666    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s7h\" (UniqueName: \"kubernetes.io/projected/46929db8-c3de-4e58-90e3-3099456b9018-kube-api-access-n9s7h\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.296866 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.296851    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ht4s\" (UniqueName: \"kubernetes.io/projected/7d998f53-1c5a-4144-880c-4c69c558ab97-kube-api-access-5ht4s\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.297099 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.297073    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9z2m\" (UniqueName: \"kubernetes.io/projected/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-kube-api-access-k9z2m\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.297334 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.297319    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqp8\" (UniqueName: \"kubernetes.io/projected/d4205e63-79f8-4bda-861a-5402609c037f-kube-api-access-swqp8\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.297686 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.297668    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkc48\" (UniqueName: \"kubernetes.io/projected/ae27e7a7-3d44-45dc-a232-4e85a5027a12-kube-api-access-mkc48\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.305674 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.303896    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7ph\" (UniqueName: \"kubernetes.io/projected/6a6dde53-407d-43ce-84df-30c1a1e08580-kube-api-access-lf7ph\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.306274 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.306256    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-942jl\" (UniqueName: \"kubernetes.io/projected/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-kube-api-access-942jl\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.306354 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.306291    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr2f5\" (UniqueName: \"kubernetes.io/projected/462389b8-254c-4f99-ac14-5b66525f62dd-kube-api-access-qr2f5\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.386779 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.386748    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:13:44.431046 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.431020    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:13:44.434820 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.434803    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:13:44.461472 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.461449    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:13:44.464700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.464676    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zf867"
Oct 31 00:13:44.468963 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.468951    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:13:44.473197 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.473182    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:44.499208 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:44.499183    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6011a7bf_b396_4ff3_90b5_05f7e8aadeb5.slice/crio-223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40 WatchSource:0}: Error finding container 223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40: Status 404 returned error can't find the container with id 223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40
Oct 31 00:13:44.499658 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:44.499639    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82dd2d032a1f8f743ca56dd4521d74cc.slice/crio-9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013 WatchSource:0}: Error finding container 9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013: Status 404 returned error can't find the container with id 9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013
Oct 31 00:13:44.500258 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:44.500241    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd984434bab802ab7f7b4fe5c1c36bf9.slice/crio-3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3 WatchSource:0}: Error finding container 3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3: Status 404 returned error can't find the container with id 3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3
Oct 31 00:13:44.500867 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:44.500852    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d998f53_1c5a_4144_880c_4c69c558ab97.slice/crio-c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3 WatchSource:0}: Error finding container c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3: Status 404 returned error can't find the container with id c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3
Oct 31 00:13:44.501934 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.501915    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:13:44.503669 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.503573    2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:13:44.503669 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.503644    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:13:44.512386 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:44.512368    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46929db8_c3de_4e58_90e3_3099456b9018.slice/crio-53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d WatchSource:0}: Error finding container 53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d: Status 404 returned error can't find the container with id 53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d
Oct 31 00:13:44.513311 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:44.513291    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6dde53_407d_43ce_84df_30c1a1e08580.slice/crio-6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49 WatchSource:0}: Error finding container 6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49: Status 404 returned error can't find the container with id 6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49
Oct 31 00:13:44.644447 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.644402    2586 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:44.694574 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.694536    2586 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:44.704997 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.704974    2586 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:13:44.745433 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.745390    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:44.745591 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.745453    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:44.745591 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.745546    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:44.745591 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.745546    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:44.745684 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.745605    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:45.745588158 +0000 UTC m=+3.296838820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:44.745684 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.745636    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:45.74562136 +0000 UTC m=+3.296872019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:44.846281 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:44.846248    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:44.846815 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.846361    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:13:44.846815 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.846378    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:13:44.846815 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.846387    2586 projected.go:196] Error preparing data for projected volume kube-api-access-7sgxj for pod openshift-network-diagnostics/network-check-target-jxpcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:44.846815 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:44.846448    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj podName:e6e98896-64cd-4abd-94ef-a95f65f5d05d nodeName:}" failed. No retries permitted until 2026-10-31 00:13:45.846435555 +0000 UTC m=+3.397686200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sgxj" (UniqueName: "kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj") pod "network-check-target-jxpcb" (UID: "e6e98896-64cd-4abd-94ef-a95f65f5d05d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:45.091313 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.091287    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:45.091502 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.091403    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:45.092053 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.092013    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cjm6" event={"ID":"6a6dde53-407d-43ce-84df-30c1a1e08580","Type":"ContainerStarted","Data":"6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49"}
Oct 31 00:13:45.093066 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.093047    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6" event={"ID":"46929db8-c3de-4e58-90e3-3099456b9018","Type":"ContainerStarted","Data":"53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d"}
Oct 31 00:13:45.094054 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.094035    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"82dd2d032a1f8f743ca56dd4521d74cc","Type":"ContainerStarted","Data":"9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013"}
Oct 31 00:13:45.095081 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.095066    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"fd984434bab802ab7f7b4fe5c1c36bf9","Type":"ContainerStarted","Data":"3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3"}
Oct 31 00:13:45.096089 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.096072    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-slhsd" event={"ID":"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5","Type":"ContainerStarted","Data":"223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40"}
Oct 31 00:13:45.097025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.097008    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxfn8" event={"ID":"7d998f53-1c5a-4144-880c-4c69c558ab97","Type":"ContainerStarted","Data":"c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3"}
Oct 31 00:13:45.200707 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:45.200675    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4205e63_79f8_4bda_861a_5402609c037f.slice/crio-e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5 WatchSource:0}: Error finding container e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5: Status 404 returned error can't find the container with id e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5
Oct 31 00:13:45.205736 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.205695    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:08:43 +0000 UTC" deadline="2028-04-14 00:39:05.454921794 +0000 UTC"
Oct 31 00:13:45.205736 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.205733    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12744h25m20.249191481s"
Oct 31 00:13:45.283603 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:45.283566    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de17cd3_32c6_464e_97a6_e9d07f2dbfb0.slice/crio-2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b WatchSource:0}: Error finding container 2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b: Status 404 returned error can't find the container with id 2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b
Oct 31 00:13:45.314270 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:45.314227    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462389b8_254c_4f99_ac14_5b66525f62dd.slice/crio-52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb WatchSource:0}: Error finding container 52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb: Status 404 returned error can't find the container with id 52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb
Oct 31 00:13:45.332261 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:45.332235    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb7b42a_47a4_4f59_90a6_2c4c40ac55cb.slice/crio-966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d WatchSource:0}: Error finding container 966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d: Status 404 returned error can't find the container with id 966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d
Oct 31 00:13:45.373697 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:13:45.373675    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae27e7a7_3d44_45dc_a232_4e85a5027a12.slice/crio-6604bb21aa292ee9b9a5e50b99bc0e5f5d28e816d509016b588ce24c889253a6 WatchSource:0}: Error finding container 6604bb21aa292ee9b9a5e50b99bc0e5f5d28e816d509016b588ce24c889253a6: Status 404 returned error can't find the container with id 6604bb21aa292ee9b9a5e50b99bc0e5f5d28e816d509016b588ce24c889253a6
Oct 31 00:13:45.754297 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.753808    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:45.754297 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.753874    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:45.754297 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.754042    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:45.754297 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.754108    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:47.754089336 +0000 UTC m=+5.305339985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:45.754297 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.754176    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:45.754297 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.754220    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:47.754205943 +0000 UTC m=+5.305456592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:45.854212 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:45.854176    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:45.854755 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.854342    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:13:45.854755 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.854360    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:13:45.854755 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.854373    2586 projected.go:196] Error preparing data for projected volume kube-api-access-7sgxj for pod openshift-network-diagnostics/network-check-target-jxpcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:45.854755 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:45.854439    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj podName:e6e98896-64cd-4abd-94ef-a95f65f5d05d nodeName:}" failed. No retries permitted until 2026-10-31 00:13:47.854422639 +0000 UTC m=+5.405673298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sgxj" (UniqueName: "kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj") pod "network-check-target-jxpcb" (UID: "e6e98896-64cd-4abd-94ef-a95f65f5d05d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:46.089227 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.088555    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:46.089227 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:46.088682    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:46.089227 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.089056    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:46.089227 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:46.089145    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:46.101172 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.101043    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerStarted","Data":"52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb"}
Oct 31 00:13:46.104786 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.104758    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b"}
Oct 31 00:13:46.106718 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.106683    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtq8q" event={"ID":"d4205e63-79f8-4bda-861a-5402609c037f","Type":"ContainerStarted","Data":"e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5"}
Oct 31 00:13:46.111120 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.111098    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89qld" event={"ID":"ae27e7a7-3d44-45dc-a232-4e85a5027a12","Type":"ContainerStarted","Data":"6604bb21aa292ee9b9a5e50b99bc0e5f5d28e816d509016b588ce24c889253a6"}
Oct 31 00:13:46.113632 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.113611    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zf867" event={"ID":"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb","Type":"ContainerStarted","Data":"966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d"}
Oct 31 00:13:46.206028 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.205989    2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:08:43 +0000 UTC" deadline="2028-05-08 06:52:59.978937725 +0000 UTC"
Oct 31 00:13:46.206028 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:46.206021    2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13326h39m13.772920598s"
Oct 31 00:13:47.088225 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:47.088190    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:47.088740 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.088341    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:47.772214 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:47.772184    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:47.772327 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:47.772236    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:47.772431 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.772401    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:47.772517 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.772504    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:51.772486016 +0000 UTC m=+9.323736664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:47.772912 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.772891    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:47.772997 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.772955    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:51.772939452 +0000 UTC m=+9.324190098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:47.873140 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:47.873096    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:47.873331 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.873299    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:13:47.873331 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.873316    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:13:47.873331 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.873329    2586 projected.go:196] Error preparing data for projected volume kube-api-access-7sgxj for pod openshift-network-diagnostics/network-check-target-jxpcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:47.873530 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:47.873386    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj podName:e6e98896-64cd-4abd-94ef-a95f65f5d05d nodeName:}" failed. No retries permitted until 2026-10-31 00:13:51.873368699 +0000 UTC m=+9.424619349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sgxj" (UniqueName: "kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj") pod "network-check-target-jxpcb" (UID: "e6e98896-64cd-4abd-94ef-a95f65f5d05d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:48.089066 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:48.089028    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:48.089644 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:48.089164    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:48.089644 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:48.089247    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:48.089644 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:48.089314    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:49.095859 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.095686    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:49.096345 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:49.095957    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:49.128709 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.128670    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"fd984434bab802ab7f7b4fe5c1c36bf9","Type":"ContainerStarted","Data":"3ab6189efdcb0651e4894fad910a285d3f36827553494bfa939c34434e7a8ea4"}
Oct 31 00:13:49.133851 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.133821    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-slhsd" event={"ID":"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5","Type":"ContainerStarted","Data":"121ccbb8b39c5aa984b19a54017cd577141e7408222fda0974de1d26c254262a"}
Oct 31 00:13:49.138884 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.138482    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerStarted","Data":"12a6fe5dd59a9fde5fc682bff1264aeb57ba81ff42e2a47d47e4926b4d867811"}
Oct 31 00:13:49.143437 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.143390    2586 generic.go:356] "Generic (PLEG): container finished" podID="82dd2d032a1f8f743ca56dd4521d74cc" containerID="20b1d143c19ecd89fac49c45f55584867f52e2f676c5a13ee59ab2562e49a859" exitCode=0
Oct 31 00:13:49.143739 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.143520    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"82dd2d032a1f8f743ca56dd4521d74cc","Type":"ContainerDied","Data":"20b1d143c19ecd89fac49c45f55584867f52e2f676c5a13ee59ab2562e49a859"}
Oct 31 00:13:49.383585 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.383526    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal" podStartSLOduration=6.383508057 podStartE2EDuration="6.383508057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:49.257817446 +0000 UTC m=+6.809068113" watchObservedRunningTime="2026-10-31 00:13:49.383508057 +0000 UTC m=+6.934758724"
Oct 31 00:13:49.502482 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:49.502382    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-slhsd" podStartSLOduration=2.709494406 podStartE2EDuration="6.502365828s" totalImagesPullingTime="3.792871422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:49.501972617 +0000 UTC m=+7.053223285" watchObservedRunningTime="2026-10-31 00:13:49.502365828 +0000 UTC m=+7.053616494"
Oct 31 00:13:50.088268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:50.087964    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:50.088268 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:50.088100    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:50.088268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:50.088161    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:50.088268 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:50.088235    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:50.165928 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:50.165030    2586 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="12a6fe5dd59a9fde5fc682bff1264aeb57ba81ff42e2a47d47e4926b4d867811" exitCode=0
Oct 31 00:13:50.165928 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:50.165145    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerDied","Data":"12a6fe5dd59a9fde5fc682bff1264aeb57ba81ff42e2a47d47e4926b4d867811"}
Oct 31 00:13:50.174807 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:50.173691    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"82dd2d032a1f8f743ca56dd4521d74cc","Type":"ContainerStarted","Data":"93b722e8dc1e3ff75aeecb3d513f4d05525e0da6c1580b3571d060daef938c30"}
Oct 31 00:13:51.092286 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.092251    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:51.092447 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.092396    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:51.180268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.180180    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vxfn8" event={"ID":"7d998f53-1c5a-4144-880c-4c69c558ab97","Type":"ContainerStarted","Data":"bb855a6f1d590edff3229c403bf277bcdb088883265a00564df9a6a15a9d6506"}
Oct 31 00:13:51.183792 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.183762    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6" event={"ID":"46929db8-c3de-4e58-90e3-3099456b9018","Type":"ContainerStarted","Data":"f22907913f8debb6c72a8313bdc354101d6b6a73505e04e414a89f9f11a9de6b"}
Oct 31 00:13:51.297986 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.297927    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" podStartSLOduration=8.297906756 podStartE2EDuration="8.297906756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:50.415284409 +0000 UTC m=+7.966535079" watchObservedRunningTime="2026-10-31 00:13:51.297906756 +0000 UTC m=+8.849157424"
Oct 31 00:13:51.489384 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.489308    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:51.490195 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.490145    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:51.609918 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.608889    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vxfn8" podStartSLOduration=3.055290498 podStartE2EDuration="8.608869252s" totalImagesPullingTime="5.553578754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:51.298632699 +0000 UTC m=+8.849883366" watchObservedRunningTime="2026-10-31 00:13:51.608869252 +0000 UTC m=+9.160119921"
Oct 31 00:13:51.807875 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.807803    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:51.807875 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.807863    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:51.808062 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.808005    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:51.808062 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.808061    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:59.808044538 +0000 UTC m=+17.359295200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:51.808460 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.808441    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:51.808560 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.808512    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:13:59.808494284 +0000 UTC m=+17.359744936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:51.909316 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.908987    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:51.909316 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.909189    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:13:51.909316 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.909209    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:13:51.909316 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.909222    2586 projected.go:196] Error preparing data for projected volume kube-api-access-7sgxj for pod openshift-network-diagnostics/network-check-target-jxpcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:51.909316 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:51.909277    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj podName:e6e98896-64cd-4abd-94ef-a95f65f5d05d nodeName:}" failed. No retries permitted until 2026-10-31 00:13:59.909259013 +0000 UTC m=+17.460509693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sgxj" (UniqueName: "kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj") pod "network-check-target-jxpcb" (UID: "e6e98896-64cd-4abd-94ef-a95f65f5d05d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:51.932268 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.931941    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:51.932786 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:51.932615    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:13:52.088069 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:52.088036    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:52.088245 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:52.088168    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:52.088582 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:52.088562    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:52.088685 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:52.088668    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:53.090974 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:53.089628    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:53.090974 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:53.089758    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:53.258650 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:53.258536    2586 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 00:13:53.888199 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:53.888083    2586 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:13:53.258552486Z","UUID":"9b8327ca-1ec0-4ac2-819d-2f4214ecd8ad","Handler":null,"Name":"","Endpoint":""}
Oct 31 00:13:53.890308 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:53.890284    2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 00:13:53.890431 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:53.890316    2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 00:13:54.088550 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.088518    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:54.088736 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.088567    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:54.088736 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:54.088674    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:54.088840 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:54.088815    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:54.191784 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.191707    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6cjm6" event={"ID":"6a6dde53-407d-43ce-84df-30c1a1e08580","Type":"ContainerStarted","Data":"a65a0c0acd8631c9205ccaf5deb9b08ed769ba23ac87a3d44345010689f1f4d6"}
Oct 31 00:13:54.194836 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.194801    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6" event={"ID":"46929db8-c3de-4e58-90e3-3099456b9018","Type":"ContainerStarted","Data":"e6f1e0b805c23ac30a82a4cc983c686f60b41735ecf74b76996420a37f1c90e3"}
Oct 31 00:13:54.196255 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.196229    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zf867" event={"ID":"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb","Type":"ContainerStarted","Data":"a2284a792f8a09258eeeb9594f499f84070883f7ac5a332035bee89eb9a69055"}
Oct 31 00:13:54.311021 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.310570    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-6cjm6" podStartSLOduration=2.804826736 podStartE2EDuration="11.310552359s" totalImagesPullingTime="8.505725623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:54.309832775 +0000 UTC m=+11.861083441" watchObservedRunningTime="2026-10-31 00:13:54.310552359 +0000 UTC m=+11.861803027"
Oct 31 00:13:54.431638 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:54.431379    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-zf867" podStartSLOduration=3.491836535 podStartE2EDuration="11.431363322s" totalImagesPullingTime="7.939526787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:54.431094206 +0000 UTC m=+11.982344873" watchObservedRunningTime="2026-10-31 00:13:54.431363322 +0000 UTC m=+11.982613990"
Oct 31 00:13:55.088068 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:55.088035    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:55.088233 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:55.088194    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:55.210046 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:55.210005    2586 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="f12dd47ea84482840dbc7704fb5d1a4e94613a0b8501b965e3827d7352120f50" exitCode=0
Oct 31 00:13:55.210046 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:55.210045    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerDied","Data":"f12dd47ea84482840dbc7704fb5d1a4e94613a0b8501b965e3827d7352120f50"}
Oct 31 00:13:55.213540 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:55.213239    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xtq8q" event={"ID":"d4205e63-79f8-4bda-861a-5402609c037f","Type":"ContainerStarted","Data":"6923dc49080264b6ae389bb5b5276a8fbf3323e2008cc1de9426559ed665a7d4"}
Oct 31 00:13:55.556630 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:55.556576    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xtq8q" podStartSLOduration=4.203299109 podStartE2EDuration="12.556561055s" totalImagesPullingTime="8.353261946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:55.556165656 +0000 UTC m=+13.107416322" watchObservedRunningTime="2026-10-31 00:13:55.556561055 +0000 UTC m=+13.107811719"
Oct 31 00:13:56.088724 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:56.088660    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:56.088891 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:56.088707    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:56.088891 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:56.088824    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:56.088993 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:56.088906    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:56.216657 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:56.216577    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6" event={"ID":"46929db8-c3de-4e58-90e3-3099456b9018","Type":"ContainerStarted","Data":"e8352cc4a889cd74e0f89749b38c9abfb7179d2d41b3e09faf8c4c1066853e47"}
Oct 31 00:13:56.217886 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:56.217864    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89qld" event={"ID":"ae27e7a7-3d44-45dc-a232-4e85a5027a12","Type":"ContainerStarted","Data":"e0cea18a8a4b9f336f5c86404199b599700d01d4be27dcba6f738dae3360c656"}
Oct 31 00:13:56.338252 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:56.338190    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6" podStartSLOduration=2.824372293 podStartE2EDuration="13.338171391s" totalImagesPullingTime="10.513799098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:56.337520771 +0000 UTC m=+13.888771439" watchObservedRunningTime="2026-10-31 00:13:56.338171391 +0000 UTC m=+13.889422060"
Oct 31 00:13:56.458917 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:56.458849    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-89qld" podStartSLOduration=2.965733885 podStartE2EDuration="13.458835099s" totalImagesPullingTime="10.493101214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:13:56.458594519 +0000 UTC m=+14.009845186" watchObservedRunningTime="2026-10-31 00:13:56.458835099 +0000 UTC m=+14.010085766"
Oct 31 00:13:57.088745 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:57.088716    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:57.088866 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:57.088833    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:57.221726 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:57.221640    2586 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="566ddf828cc1951aa0fb32ce1cf3a9717ed06cb959b00ab7dec66038bac9aa57" exitCode=0
Oct 31 00:13:57.222365 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:57.221718    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerDied","Data":"566ddf828cc1951aa0fb32ce1cf3a9717ed06cb959b00ab7dec66038bac9aa57"}
Oct 31 00:13:58.088342 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:58.088306    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:58.088550 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:58.088354    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:58.088550 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:58.088469    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:13:58.088679 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:58.088608    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:13:59.088157 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:59.087951    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:59.088718 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.088276    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:13:59.228379 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:59.228263    2586 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="95305ce2ce6cfbbbf2189a6fce70f541ce2ce26fd0d5d56f7d05e9b1de7496eb" exitCode=0
Oct 31 00:13:59.228379 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:59.228320    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerDied","Data":"95305ce2ce6cfbbbf2189a6fce70f541ce2ce26fd0d5d56f7d05e9b1de7496eb"}
Oct 31 00:13:59.873593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:59.873560    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:13:59.873787 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:59.873621    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:13:59.873787 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.873707    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:59.873787 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.873715    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:59.873787 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.873767    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.873747913 +0000 UTC m=+33.424998560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:13:59.873787 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.873788    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.87377815 +0000 UTC m=+33.425028797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:13:59.974473 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:13:59.974382    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:13:59.974642 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.974544    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:13:59.974642 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.974569    2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:13:59.974642 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.974582    2586 projected.go:196] Error preparing data for projected volume kube-api-access-7sgxj for pod openshift-network-diagnostics/network-check-target-jxpcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:13:59.974794 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:13:59.974650    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj podName:e6e98896-64cd-4abd-94ef-a95f65f5d05d nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.974631906 +0000 UTC m=+33.525882555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sgxj" (UniqueName: "kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj") pod "network-check-target-jxpcb" (UID: "e6e98896-64cd-4abd-94ef-a95f65f5d05d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:14:00.087863 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:00.087832    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:00.088029 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:00.087832    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:00.088029 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:00.087949    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:00.088125 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:00.088024    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:01.088382 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:01.088355    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:01.088805 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:01.088504    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:02.088270 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.088115    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:02.088373 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.088173    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:02.088373 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:02.088338    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:02.088798 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:02.088471    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:02.235890 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.235858    2586 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="f7af4025b5385d85c91b6b8882eb6a7f735aca493618294e67e0e712325a6e43" exitCode=0
Oct 31 00:14:02.236044 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.235936    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerDied","Data":"f7af4025b5385d85c91b6b8882eb6a7f735aca493618294e67e0e712325a6e43"}
Oct 31 00:14:02.238958 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.238939    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"cf4bc96af0e8d918f49e39bc4a561e14a36abe11b38fb935431e4bb5d14849e8"}
Oct 31 00:14:02.239027 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.239001    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"736695b651592fcbcabf90f8e1c4002ee80c6330ed2b1582e02f7fd36e2aeac6"}
Oct 31 00:14:02.239069 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.239033    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"ff9422881479b8614321ab49066d4b58f387bde794d07ff486fc0b4ee3fbdb48"}
Oct 31 00:14:02.239098 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.239070    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"ca336e04c2427d40229a97d4e2ec5236e279475b66ec9e2141bc2cda078e8682"}
Oct 31 00:14:02.239098 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.239096    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"c284048cb92e540f9a46e81e019c40f1eb5b6fb437996ad92dae33ca255b9894"}
Oct 31 00:14:02.239159 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:02.239127    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"4a0294976789c5597ea6b1e48b39609d11da10abce25c2bbbe5e8efd37e456ad"}
Oct 31 00:14:03.089849 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:03.089817    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:03.090327 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:03.089944    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:03.245988 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:03.245961    2586 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="2fd89382d4eaba9edb0e351e2fc2655584f15c7e44a39e9b8d43ff157ab9b49d" exitCode=0
Oct 31 00:14:03.245988 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:03.245997    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerDied","Data":"2fd89382d4eaba9edb0e351e2fc2655584f15c7e44a39e9b8d43ff157ab9b49d"}
Oct 31 00:14:04.087929 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:04.087896    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:04.088072 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:04.087935    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:04.088072 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:04.088007    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:04.088154 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:04.088070    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:04.251670 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:04.251576    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" event={"ID":"462389b8-254c-4f99-ac14-5b66525f62dd","Type":"ContainerStarted","Data":"e7a1d60e7c23cbf8ab7e7f114301c02283a91fd96848b92f17f1e84815a8f7b9"}
Oct 31 00:14:04.254599 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:04.254575    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"2199e17b687671388a93b12f1f195304eb720036202e7a8e764b17eb0f91c987"}
Oct 31 00:14:04.383289 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:04.383235    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nnpg6" podStartSLOduration=7.94250102 podStartE2EDuration="21.383221874s" totalImagesPullingTime="13.440720854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:04.382916384 +0000 UTC m=+21.934167052" watchObservedRunningTime="2026-10-31 00:14:04.383221874 +0000 UTC m=+21.934472541"
Oct 31 00:14:05.088815 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:05.088776    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:05.088971 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:05.088888    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:06.088135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.088113    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:06.088530 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:06.088208    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:06.088530 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.088241    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:06.088530 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:06.088293    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:06.261997 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.261896    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" event={"ID":"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0","Type":"ContainerStarted","Data":"4820b236f069d7effc923b49587f2aa7fc09bf04275c3d4ec1e21d5c9b885961"}
Oct 31 00:14:06.262889 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.262681    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:06.262889 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.262808    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:06.279484 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.279460    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:06.279728 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.279716    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:06.549269 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:06.549218    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6" podStartSLOduration=7.241650087 podStartE2EDuration="23.549205908s" totalImagesPullingTime="16.307555821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:06.497027783 +0000 UTC m=+24.048278450" watchObservedRunningTime="2026-10-31 00:14:06.549205908 +0000 UTC m=+24.100456574"
Oct 31 00:14:07.088364 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:07.088331    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:07.088885 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:07.088459    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:07.264340 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:07.264308    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:14:08.087986 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.087956    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:08.087986 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.087983    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:08.088194 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:08.088048    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:08.088194 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:08.088154    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:08.266547 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.266520    2586 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:14:08.794319 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.794137    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-65fz2"]
Oct 31 00:14:08.794485 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.794401    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:08.794526 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:08.794504    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:08.796824 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.796803    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxpcb"]
Oct 31 00:14:08.796911 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.796894    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:08.796975 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:08.796961    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:08.845597 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.845573    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5725k"]
Oct 31 00:14:08.845677 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:08.845665    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:08.845773 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:08.845754    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:09.586983 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:09.586951    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:10.088621 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:10.088587    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:10.088840 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:10.088679    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:10.088840 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:10.088697    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:10.088840 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:10.088798    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:10.088943 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:10.088898    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:10.088976 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:10.088964    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:12.088835 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:12.088798    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:12.089240 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:12.088842    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:12.089240 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:12.088908    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:12.089240 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:12.088929    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:12.089240 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:12.088994    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:12.089240 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:12.089066    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:14.088433 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.088396    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:14.088798 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.088433    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:14.088798 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.088506    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:14.088798 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.088519    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5725k" podUID="4c43a258-8b6a-4d05-a56f-dfd659fc37d8"
Oct 31 00:14:14.088798 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.088579    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxpcb" podUID="e6e98896-64cd-4abd-94ef-a95f65f5d05d"
Oct 31 00:14:14.088798 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.088648    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-65fz2" podUID="6362fc09-4b02-49dd-8e75-db40d935cc71"
Oct 31 00:14:14.225599 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.225525    2586 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeReady"
Oct 31 00:14:14.225710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.225650    2586 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 00:14:14.315144 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.315118    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7j8dt"]
Oct 31 00:14:14.386128 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.386092    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"]
Oct 31 00:14:14.386295 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.386202    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:14.407857 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.407820    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-567894c8cd-bksgp"]
Oct 31 00:14:14.408009 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.407954    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.421696 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.421668    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c7d9879df-g4m8t"]
Oct 31 00:14:14.421810 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.421770    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.435869 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.435846    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"]
Oct 31 00:14:14.435969 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.435905    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.443497 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.443475    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.445889 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.445872    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.448255 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.448239    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"]
Oct 31 00:14:14.448377 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.448362    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.461964 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.461944    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 00:14:14.471858 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.471837    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"]
Oct 31 00:14:14.471967 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.471950    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:14.474817 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.474798    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrlst\" (UniqueName: \"kubernetes.io/projected/e0762913-8550-41b9-a1a8-d2df14f88004-kube-api-access-qrlst\") pod \"kas-connection-checker-685895c7c9-7j8dt\" (UID: \"e0762913-8550-41b9-a1a8-d2df14f88004\") " pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:14.486044 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.485968    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-k6mcf"]
Oct 31 00:14:14.486133 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.486045    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:14.508677 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.508655    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d45469b6c-mczsm"]
Oct 31 00:14:14.508778 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.508757    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:14.522060 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.522043    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-rt22m"]
Oct 31 00:14:14.522166 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.522152    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.544141 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544105    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.544244 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544156    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 00:14:14.544244 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544113    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.544244 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544156    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.544244 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544104    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.544244 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544231    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 00:14:14.544473 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544247    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.544473 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544248    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.544473 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544278    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 00:14:14.544473 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544278    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.544473 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544373    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.544723 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.544709    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 00:14:14.548077 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.547989    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sxf6j"]
Oct 31 00:14:14.548282 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.548266    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.553829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.553812    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 00:14:14.563580 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.563559    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 00:14:14.563667 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.563595    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 00:14:14.563935 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.563922    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"]
Oct 31 00:14:14.564034 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.564022    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:14.576048 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576030    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.576142 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576056    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171545bb-2c69-4ce1-828c-539f326f1c37-serving-cert\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.576142 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576074    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.576142 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576089    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdpmc\" (UniqueName: \"kubernetes.io/projected/77330f26-0bd9-4176-86b7-780fed040b10-kube-api-access-mdpmc\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.576142 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576104    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576342 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576160    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576342 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576241    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171545bb-2c69-4ce1-828c-539f326f1c37-config\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.576342 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576273    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576342 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576333    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866b4904-8c80-44cf-9912-5de2ccd545b8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:14.576532 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576393    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-default-certificate\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.576532 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576450    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.576532 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576488    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4zv5\" (UniqueName: \"kubernetes.io/projected/b899807e-b82b-4d93-b1b7-ce371ff91281-kube-api-access-l4zv5\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.576662 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576538    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlst\" (UniqueName: \"kubernetes.io/projected/e0762913-8550-41b9-a1a8-d2df14f88004-kube-api-access-qrlst\") pod \"kas-connection-checker-685895c7c9-7j8dt\" (UID: \"e0762913-8550-41b9-a1a8-d2df14f88004\") " pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:14.576662 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576561    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576662 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576577    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576662 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576597    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576662 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576642    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576662 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576659    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.576920 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576678    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-stats-auth\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.576920 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576706    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qb9k\" (UniqueName: \"kubernetes.io/projected/171545bb-2c69-4ce1-828c-539f326f1c37-kube-api-access-5qb9k\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.576920 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576739    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:14.576920 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576796    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dq55\" (UniqueName: \"kubernetes.io/projected/07c85ed3-44fd-4fb8-824f-468184be0d4d-kube-api-access-2dq55\") pod \"volume-data-source-validator-58c9f5f46d-h88qb\" (UID: \"07c85ed3-44fd-4fb8-824f-468184be0d4d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:14.576920 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.576811    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.586052 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.586039    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"]
Oct 31 00:14:14.586155 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.586143    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.595679 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595661    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 00:14:14.595771 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595666    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 00:14:14.595846 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595830    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 00:14:14.595892 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595838    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 00:14:14.595925 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595905    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-gndw5\""
Oct 31 00:14:14.595925 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595907    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q42zw\""
Oct 31 00:14:14.595985 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.595959    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkrjn\""
Oct 31 00:14:14.596070 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.596058    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 00:14:14.596105 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.596077    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pk6r6\""
Oct 31 00:14:14.596105 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.596090    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lx8pb\""
Oct 31 00:14:14.596169 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.596131    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 00:14:14.608906 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.608892    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-crbc6"]
Oct 31 00:14:14.608998 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.608985    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.624925 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.624910    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"]
Oct 31 00:14:14.625031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.625006    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.640175 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.640157    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlst\" (UniqueName: \"kubernetes.io/projected/e0762913-8550-41b9-a1a8-d2df14f88004-kube-api-access-qrlst\") pod \"kas-connection-checker-685895c7c9-7j8dt\" (UID: \"e0762913-8550-41b9-a1a8-d2df14f88004\") " pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:14.643576 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.643559    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gzr86"]
Oct 31 00:14:14.643690 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.643675    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:14.644286 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.644268    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.644376 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.644286    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.644376 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.644289    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.644376 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.644306    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 00:14:14.644376 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.644303    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.645092 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.645075    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 00:14:14.645674 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.645659    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 00:14:14.662734 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.662706    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 00:14:14.662903 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.662884    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-clchl\""
Oct 31 00:14:14.662997 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.662908    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 00:14:14.663209 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.663193    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z2qz5\""
Oct 31 00:14:14.663340 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.663326    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xwrcd\""
Oct 31 00:14:14.667833 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.667816    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q5zwx"]
Oct 31 00:14:14.667922 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.667914    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.677794 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.677777    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.677884 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.677806    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.677884 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.677823    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.677884 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.677843    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.678031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.677899    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.678031 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.677917    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 00:14:14.678031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.677937    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-stats-auth\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.678031 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.677976    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.177957912 +0000 UTC m=+32.729208580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : secret "router-metrics-certs-default" not found
Oct 31 00:14:14.678031 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678008    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbln\" (UniqueName: \"kubernetes.io/projected/aebe9cd7-a93e-4707-b53c-fdaeddc05258-kube-api-access-jxbln\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.678316 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678043    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.678316 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678070    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-service-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.678316 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678181    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.678316 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678273    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.678316 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.678280    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.17826523 +0000 UTC m=+32.729515893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : configmap references non-existent config key: service-ca.crt
Oct 31 00:14:14.678316 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678307    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-default-certificate\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678338    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppnw\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678383    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5d5\" (UniqueName: \"kubernetes.io/projected/6bbd3db6-4290-4d6c-9735-519c8585376b-kube-api-access-mw5d5\") pod \"kas-connection-checker-685895c7c9-sxf6j\" (UID: \"6bbd3db6-4290-4d6c-9735-519c8585376b\") " pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678427    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678453    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678476    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678515    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4zv5\" (UniqueName: \"kubernetes.io/projected/b899807e-b82b-4d93-b1b7-ce371ff91281-kube-api-access-l4zv5\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678552    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.678593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678581    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b34c50-498f-4371-b594-d3fd404192af-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678606    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aebe9cd7-a93e-4707-b53c-fdaeddc05258-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678632    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678659    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8lrp\" (UniqueName: \"kubernetes.io/projected/9cd937ab-d46d-4bff-8049-485b18bfdb6c-kube-api-access-m8lrp\") pod \"kas-connection-checker-685895c7c9-k6mcf\" (UID: \"9cd937ab-d46d-4bff-8049-485b18bfdb6c\") " pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678684    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97f5b\" (UniqueName: \"kubernetes.io/projected/46f076a2-ab34-4a66-a113-66fa2291345d-kube-api-access-97f5b\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678710    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678742    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgd7\" (UniqueName: \"kubernetes.io/projected/d2b34c50-498f-4371-b594-d3fd404192af-kube-api-access-6cgd7\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.678812 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678785    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qb9k\" (UniqueName: \"kubernetes.io/projected/171545bb-2c69-4ce1-828c-539f326f1c37-kube-api-access-5qb9k\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.679000 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678812    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:14.679000 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678838    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.679000 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678864    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dq55\" (UniqueName: \"kubernetes.io/projected/07c85ed3-44fd-4fb8-824f-468184be0d4d-kube-api-access-2dq55\") pod \"volume-data-source-validator-58c9f5f46d-h88qb\" (UID: \"07c85ed3-44fd-4fb8-824f-468184be0d4d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:14.679000 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678902    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866b4904-8c80-44cf-9912-5de2ccd545b8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:14.679000 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678931    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.679000 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678936    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.678999    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdpmc\" (UniqueName: \"kubernetes.io/projected/77330f26-0bd9-4176-86b7-780fed040b10-kube-api-access-mdpmc\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.679013    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679029    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.679073    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls podName:77330f26-0bd9-4176-86b7-780fed040b10 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.179054295 +0000 UTC m=+32.730304946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-l4dzs" (UID: "77330f26-0bd9-4176-86b7-780fed040b10") : secret "samples-operator-tls" not found
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679089    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679121    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-snapshots\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.679160 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679150    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679165    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679176    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b34c50-498f-4371-b594-d3fd404192af-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679203    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171545bb-2c69-4ce1-828c-539f326f1c37-serving-cert\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679227    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-tmp\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679254    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f076a2-ab34-4a66-a113-66fa2291345d-serving-cert\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679281    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679312    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171545bb-2c69-4ce1-828c-539f326f1c37-config\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.679428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679336    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.679816 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.679543    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.680124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.680105    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171545bb-2c69-4ce1-828c-539f326f1c37-config\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.680387 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.680359    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.680481 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.680468    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:14.680520 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.680482    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567894c8cd-bksgp: secret "image-registry-tls" not found
Oct 31 00:14:14.680738 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.680718    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.680777 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.680730    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls podName:7729e485-91fd-498c-8927-db2c765a9357 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.180714459 +0000 UTC m=+32.731965107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls") pod "image-registry-567894c8cd-bksgp" (UID: "7729e485-91fd-498c-8927-db2c765a9357") : secret "image-registry-tls" not found
Oct 31 00:14:14.680824 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.680805    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.680854 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.680809    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-stats-auth\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.681021 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.680999    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 00:14:14.681111 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.681095    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert podName:866b4904-8c80-44cf-9912-5de2ccd545b8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.181075926 +0000 UTC m=+32.732326590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-5xjzr" (UID: "866b4904-8c80-44cf-9912-5de2ccd545b8") : secret "networking-console-plugin-cert" not found
Oct 31 00:14:14.681709 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681691    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866b4904-8c80-44cf-9912-5de2ccd545b8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:14.681829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681817    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7j8dt"]
Oct 31 00:14:14.681862 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681843    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"]
Oct 31 00:14:14.681862 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681839    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-default-certificate\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.681922 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681889    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171545bb-2c69-4ce1-828c-539f326f1c37-serving-cert\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.681922 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681909    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.681984 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681943    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567894c8cd-bksgp"]
Oct 31 00:14:14.681984 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681966    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"]
Oct 31 00:14:14.682037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.681985    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"]
Oct 31 00:14:14.682037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682000    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c7d9879df-g4m8t"]
Oct 31 00:14:14.682037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682014    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-k6mcf"]
Oct 31 00:14:14.682037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682028    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sxf6j"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682045    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d45469b6c-mczsm"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682063    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682081    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzr86"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682102    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5zwx"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682128    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682147    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682161    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-rt22m"]
Oct 31 00:14:14.682173 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682176    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-crbc6"]
Oct 31 00:14:14.682425 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.682190    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"]
Oct 31 00:14:14.718206 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.718186    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:14.743600 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.743574    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.744689 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.744655    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qb9k\" (UniqueName: \"kubernetes.io/projected/171545bb-2c69-4ce1-828c-539f326f1c37-kube-api-access-5qb9k\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.744774 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.744759    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdpmc\" (UniqueName: \"kubernetes.io/projected/77330f26-0bd9-4176-86b7-780fed040b10-kube-api-access-mdpmc\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:14.745309 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.745283    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:14.746172 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746152    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dq55\" (UniqueName: \"kubernetes.io/projected/07c85ed3-44fd-4fb8-824f-468184be0d4d-kube-api-access-2dq55\") pod \"volume-data-source-validator-58c9f5f46d-h88qb\" (UID: \"07c85ed3-44fd-4fb8-824f-468184be0d4d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:14.746677 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746656    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.746763 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746662    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 00:14:14.746763 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746675    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.746763 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746708    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.746763 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746724    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 00:14:14.746763 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746753    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.747004 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746765    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.747004 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746798    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:14:14.747004 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746811    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.747004 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746876    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 00:14:14.747004 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.746870    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:14.747860 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.747840    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 00:14:14.755492 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.755473    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4zv5\" (UniqueName: \"kubernetes.io/projected/b899807e-b82b-4d93-b1b7-ce371ff91281-kube-api-access-l4zv5\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:14.763529 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763507    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 00:14:14.763620 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763537    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 00:14:14.763620 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763556    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 00:14:14.763620 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763586    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 00:14:14.763753 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763638    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-qszwm\""
Oct 31 00:14:14.763753 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763731    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gdwzq\""
Oct 31 00:14:14.763820 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763752    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j5mcv\""
Oct 31 00:14:14.763936 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.763915    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74dxc\""
Oct 31 00:14:14.780311 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780279    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-snapshots\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.780462 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780324    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49spz\" (UniqueName: \"kubernetes.io/projected/0347cd21-2175-4a7c-8a9c-239cf3b5a392-kube-api-access-49spz\") pod \"network-check-source-6f78d59f99-9lx75\" (UID: \"0347cd21-2175-4a7c-8a9c-239cf3b5a392\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:14.780462 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780353    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.780462 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780382    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b34c50-498f-4371-b594-d3fd404192af-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.780462 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780408    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-tmp\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.780462 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780451    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f076a2-ab34-4a66-a113-66fa2291345d-serving-cert\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780477    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780507    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780581    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-config\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.780587    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.780602    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.780626    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45469b6c-mczsm: secret "image-registry-tls" not found
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.780660    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls podName:aebe9cd7-a93e-4707-b53c-fdaeddc05258 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.280643226 +0000 UTC m=+32.831893899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tlc2z" (UID: "aebe9cd7-a93e-4707-b53c-fdaeddc05258") : secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.780680    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls podName:c86b2c1b-dd70-4d49-a5ad-44aaeca443c9 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.280672477 +0000 UTC m=+32.831923122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls") pod "image-registry-7d45469b6c-mczsm" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9") : secret "image-registry-tls" not found
Oct 31 00:14:14.780719 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780708    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53d8e59-7949-41f4-a271-1f6bf7288552-config-volume\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780737    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780766    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbln\" (UniqueName: \"kubernetes.io/projected/aebe9cd7-a93e-4707-b53c-fdaeddc05258-kube-api-access-jxbln\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780842    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-service-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780888    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3734cc90-7907-4498-9a6b-7bae4757ff0b-serving-cert\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780944    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-tmp\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.780946    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nppnw\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781050    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5d5\" (UniqueName: \"kubernetes.io/projected/6bbd3db6-4290-4d6c-9735-519c8585376b-kube-api-access-mw5d5\") pod \"kas-connection-checker-685895c7c9-sxf6j\" (UID: \"6bbd3db6-4290-4d6c-9735-519c8585376b\") " pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781084    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781112    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781142    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781170    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j7ml\" (UniqueName: \"kubernetes.io/projected/55ad7d0d-4b43-4377-ab24-9d4768c82cef-kube-api-access-4j7ml\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781211    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-trusted-ca\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781248    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9s6\" (UniqueName: \"kubernetes.io/projected/f53d8e59-7949-41f4-a271-1f6bf7288552-kube-api-access-jq9s6\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781278    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b34c50-498f-4371-b594-d3fd404192af-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781308    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aebe9cd7-a93e-4707-b53c-fdaeddc05258-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781336    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8m4c\" (UniqueName: \"kubernetes.io/projected/3734cc90-7907-4498-9a6b-7bae4757ff0b-kube-api-access-v8m4c\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781360    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781389    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lrp\" (UniqueName: \"kubernetes.io/projected/9cd937ab-d46d-4bff-8049-485b18bfdb6c-kube-api-access-m8lrp\") pod \"kas-connection-checker-685895c7c9-k6mcf\" (UID: \"9cd937ab-d46d-4bff-8049-485b18bfdb6c\") " pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781406    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-service-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781445    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97f5b\" (UniqueName: \"kubernetes.io/projected/46f076a2-ab34-4a66-a113-66fa2291345d-kube-api-access-97f5b\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781488    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781515    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55ad7d0d-4b43-4377-ab24-9d4768c82cef-cert\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781548    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgd7\" (UniqueName: \"kubernetes.io/projected/d2b34c50-498f-4371-b594-d3fd404192af-kube-api-access-6cgd7\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781603    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781633    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53d8e59-7949-41f4-a271-1f6bf7288552-tmp-dir\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.781633 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.781637    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.782445 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.782000    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b34c50-498f-4371-b594-d3fd404192af-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.782445 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.782013    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.782445 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.782395    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-snapshots\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.782603 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.782578    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.783182 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.783132    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f076a2-ab34-4a66-a113-66fa2291345d-serving-cert\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.783182 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.783158    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aebe9cd7-a93e-4707-b53c-fdaeddc05258-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.783327 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.783248    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b34c50-498f-4371-b594-d3fd404192af-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.783687 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.783653    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.785034 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.785008    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.785130 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.785068    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.800400 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.800385    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:14.817875 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.817581    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:14.844025 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.843996    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbln\" (UniqueName: \"kubernetes.io/projected/aebe9cd7-a93e-4707-b53c-fdaeddc05258-kube-api-access-jxbln\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:14.844711 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.844688    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5d5\" (UniqueName: \"kubernetes.io/projected/6bbd3db6-4290-4d6c-9735-519c8585376b-kube-api-access-mw5d5\") pod \"kas-connection-checker-685895c7c9-sxf6j\" (UID: \"6bbd3db6-4290-4d6c-9735-519c8585376b\") " pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:14.845001 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.844975    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppnw\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.846649 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.846629    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:14.846649 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.846641    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f5b\" (UniqueName: \"kubernetes.io/projected/46f076a2-ab34-4a66-a113-66fa2291345d-kube-api-access-97f5b\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.847632 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.847613    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lrp\" (UniqueName: \"kubernetes.io/projected/9cd937ab-d46d-4bff-8049-485b18bfdb6c-kube-api-access-m8lrp\") pod \"kas-connection-checker-685895c7c9-k6mcf\" (UID: \"9cd937ab-d46d-4bff-8049-485b18bfdb6c\") " pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:14.847795 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.847776    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgd7\" (UniqueName: \"kubernetes.io/projected/d2b34c50-498f-4371-b594-d3fd404192af-kube-api-access-6cgd7\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:14.877798 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.877449    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:14.884935 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.884900    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3734cc90-7907-4498-9a6b-7bae4757ff0b-serving-cert\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.885037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.884983    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7ml\" (UniqueName: \"kubernetes.io/projected/55ad7d0d-4b43-4377-ab24-9d4768c82cef-kube-api-access-4j7ml\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.885037 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885015    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-trusted-ca\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.885144 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885045    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9s6\" (UniqueName: \"kubernetes.io/projected/f53d8e59-7949-41f4-a271-1f6bf7288552-kube-api-access-jq9s6\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.885144 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885076    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8m4c\" (UniqueName: \"kubernetes.io/projected/3734cc90-7907-4498-9a6b-7bae4757ff0b-kube-api-access-v8m4c\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.885144 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885101    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.885144 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885129    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55ad7d0d-4b43-4377-ab24-9d4768c82cef-cert\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.885330 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885187    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53d8e59-7949-41f4-a271-1f6bf7288552-tmp-dir\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.885330 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885247    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49spz\" (UniqueName: \"kubernetes.io/projected/0347cd21-2175-4a7c-8a9c-239cf3b5a392-kube-api-access-49spz\") pod \"network-check-source-6f78d59f99-9lx75\" (UID: \"0347cd21-2175-4a7c-8a9c-239cf3b5a392\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:14.885330 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885312    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-config\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.885496 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885339    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53d8e59-7949-41f4-a271-1f6bf7288552-config-volume\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.885990 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.885967    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53d8e59-7949-41f4-a271-1f6bf7288552-config-volume\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.886583 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.886558    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 00:14:14.886690 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:14.886634    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls podName:f53d8e59-7949-41f4-a271-1f6bf7288552 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:15.386614453 +0000 UTC m=+32.937865117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls") pod "dns-default-q5zwx" (UID: "f53d8e59-7949-41f4-a271-1f6bf7288552") : secret "dns-default-metrics-tls" not found
Oct 31 00:14:14.887834 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.887811    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-trusted-ca\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.888772 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.888085    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53d8e59-7949-41f4-a271-1f6bf7288552-tmp-dir\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.888772 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.888694    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-config\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.888772 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.888723    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3734cc90-7907-4498-9a6b-7bae4757ff0b-serving-cert\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.890103 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.890085    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55ad7d0d-4b43-4377-ab24-9d4768c82cef-cert\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.935816 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.935743    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:14.955897 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.955871    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9s6\" (UniqueName: \"kubernetes.io/projected/f53d8e59-7949-41f4-a271-1f6bf7288552-kube-api-access-jq9s6\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:14.957453 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.957428    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49spz\" (UniqueName: \"kubernetes.io/projected/0347cd21-2175-4a7c-8a9c-239cf3b5a392-kube-api-access-49spz\") pod \"network-check-source-6f78d59f99-9lx75\" (UID: \"0347cd21-2175-4a7c-8a9c-239cf3b5a392\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:14.957910 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.957871    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7ml\" (UniqueName: \"kubernetes.io/projected/55ad7d0d-4b43-4377-ab24-9d4768c82cef-kube-api-access-4j7ml\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:14.957910 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.957864    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8m4c\" (UniqueName: \"kubernetes.io/projected/3734cc90-7907-4498-9a6b-7bae4757ff0b-kube-api-access-v8m4c\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.958019 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.957970    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:14.978504 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:14.978190    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:15.016129 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.015398    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:15.029846 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.029785    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:15.149439 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.147843    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-7j8dt"]
Oct 31 00:14:15.157465 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.157441    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:15.161335 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.161313    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0762913_8550_41b9_a1a8_d2df14f88004.slice/crio-1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542 WatchSource:0}: Error finding container 1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542: Status 404 returned error can't find the container with id 1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542
Oct 31 00:14:15.190252 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.190230    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:15.190378 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.190361    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:15.190459 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.190427    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:15.190521 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.190462    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:15.190574 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.190525    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:15.190701 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.190644    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 00:14:15.190785 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.190706    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.190689225 +0000 UTC m=+33.741939872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : secret "router-metrics-certs-default" not found
Oct 31 00:14:15.190847 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.190786    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.190774038 +0000 UTC m=+33.742024698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : configmap references non-existent config key: service-ca.crt
Oct 31 00:14:15.190986 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.190850    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 00:14:15.191042 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.191025    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert podName:866b4904-8c80-44cf-9912-5de2ccd545b8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.191010688 +0000 UTC m=+33.742261347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-5xjzr" (UID: "866b4904-8c80-44cf-9912-5de2ccd545b8") : secret "networking-console-plugin-cert" not found
Oct 31 00:14:15.191042 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.190967    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 00:14:15.191132 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.191041    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:15.191132 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.191082    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567894c8cd-bksgp: secret "image-registry-tls" not found
Oct 31 00:14:15.191193 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.191070    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls podName:77330f26-0bd9-4176-86b7-780fed040b10 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.191060352 +0000 UTC m=+33.742311011 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-l4dzs" (UID: "77330f26-0bd9-4176-86b7-780fed040b10") : secret "samples-operator-tls" not found
Oct 31 00:14:15.191193 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.191180    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls podName:7729e485-91fd-498c-8927-db2c765a9357 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.191155068 +0000 UTC m=+33.742405725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls") pod "image-registry-567894c8cd-bksgp" (UID: "7729e485-91fd-498c-8927-db2c765a9357") : secret "image-registry-tls" not found
Oct 31 00:14:15.211063 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.211037    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"]
Oct 31 00:14:15.214451 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.213834    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"]
Oct 31 00:14:15.214864 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.214839    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171545bb_2c69_4ce1_828c_539f326f1c37.slice/crio-8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac WatchSource:0}: Error finding container 8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac: Status 404 returned error can't find the container with id 8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac
Oct 31 00:14:15.280229 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.280204    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-rt22m"]
Oct 31 00:14:15.282547 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.282519    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb" event={"ID":"07c85ed3-44fd-4fb8-824f-468184be0d4d","Type":"ContainerStarted","Data":"917b5535e248c79ff0ed7de0a6d24f3782ccceac59d7f7ac3d5aeeee0238df11"}
Oct 31 00:14:15.283601 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.283580    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27" event={"ID":"171545bb-2c69-4ce1-828c-539f326f1c37","Type":"ContainerStarted","Data":"8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac"}
Oct 31 00:14:15.283809 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.283790    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f076a2_ab34_4a66_a113_66fa2291345d.slice/crio-20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa WatchSource:0}: Error finding container 20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa: Status 404 returned error can't find the container with id 20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa
Oct 31 00:14:15.284793 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.284775    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7j8dt" event={"ID":"e0762913-8550-41b9-a1a8-d2df14f88004","Type":"ContainerStarted","Data":"1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542"}
Oct 31 00:14:15.291077 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.291057    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:15.291171 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.291096    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:15.291236 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.291191    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:15.291302 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.291281    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:15.291336 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.291306    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45469b6c-mczsm: secret "image-registry-tls" not found
Oct 31 00:14:15.291373 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.291286    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls podName:aebe9cd7-a93e-4707-b53c-fdaeddc05258 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.291267049 +0000 UTC m=+33.842517701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tlc2z" (UID: "aebe9cd7-a93e-4707-b53c-fdaeddc05258") : secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:15.291373 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.291367    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls podName:c86b2c1b-dd70-4d49-a5ad-44aaeca443c9 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.291351136 +0000 UTC m=+33.842601782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls") pod "image-registry-7d45469b6c-mczsm" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9") : secret "image-registry-tls" not found
Oct 31 00:14:15.310118 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.310095    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sxf6j"]
Oct 31 00:14:15.313217 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.313195    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bbd3db6_4290_4d6c_9735_519c8585376b.slice/crio-518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2 WatchSource:0}: Error finding container 518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2: Status 404 returned error can't find the container with id 518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2
Oct 31 00:14:15.349752 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.349465    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-crbc6"]
Oct 31 00:14:15.369901 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.369876    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"]
Oct 31 00:14:15.374500 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.374471    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b34c50_498f_4371_b594_d3fd404192af.slice/crio-21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade WatchSource:0}: Error finding container 21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade: Status 404 returned error can't find the container with id 21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade
Oct 31 00:14:15.392332 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.392307    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:15.392481 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.392404    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 00:14:15.392481 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.392473    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls podName:f53d8e59-7949-41f4-a271-1f6bf7288552 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:16.392458406 +0000 UTC m=+33.943709069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls") pod "dns-default-q5zwx" (UID: "f53d8e59-7949-41f4-a271-1f6bf7288552") : secret "dns-default-metrics-tls" not found
Oct 31 00:14:15.417164 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.417143    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzr86"]
Oct 31 00:14:15.419165 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.419139    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55ad7d0d_4b43_4377_ab24_9d4768c82cef.slice/crio-43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b WatchSource:0}: Error finding container 43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b: Status 404 returned error can't find the container with id 43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b
Oct 31 00:14:15.436234 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.436212    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"]
Oct 31 00:14:15.439351 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.439325    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0347cd21_2175_4a7c_8a9c_239cf3b5a392.slice/crio-daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a WatchSource:0}: Error finding container daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a: Status 404 returned error can't find the container with id daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a
Oct 31 00:14:15.556254 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.556187    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-k6mcf"]
Oct 31 00:14:15.558711 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:15.558683    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd937ab_d46d_4bff_8049_485b18bfdb6c.slice/crio-81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf WatchSource:0}: Error finding container 81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf: Status 404 returned error can't find the container with id 81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf
Oct 31 00:14:15.897074 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.897041    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:15.897264 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.897174    2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:14:15.897329 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.897282    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:15.897329 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.897307    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret podName:6362fc09-4b02-49dd-8e75-db40d935cc71 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:47.897283956 +0000 UTC m=+65.448534602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret") pod "global-pull-secret-syncer-65fz2" (UID: "6362fc09-4b02-49dd-8e75-db40d935cc71") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:14:15.897472 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.897372    2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:14:15.897472 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:15.897456    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs podName:4c43a258-8b6a-4d05-a56f-dfd659fc37d8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:47.89743868 +0000 UTC m=+65.448689344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs") pod "network-metrics-daemon-5725k" (UID: "4c43a258-8b6a-4d05-a56f-dfd659fc37d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:14:15.998045 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:15.998015    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:16.000665 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.000636    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:16.088716 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.088686    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:16.088849 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.088801    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:16.088849 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.088689    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:16.143471 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.143437    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:14:16.143471 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.143443    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-plmbm\""
Oct 31 00:14:16.143635 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.143526    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zk5sj\""
Oct 31 00:14:16.143635 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.143563    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:14:16.143635 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.143624    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lg2hb\""
Oct 31 00:14:16.143723 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.143677    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.199819    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.199878    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.199908    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.199955    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.199970    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200016    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert podName:866b4904-8c80-44cf-9912-5de2ccd545b8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.200001527 +0000 UTC m=+35.751252198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-5xjzr" (UID: "866b4904-8c80-44cf-9912-5de2ccd545b8") : secret "networking-console-plugin-cert" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200034    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200073    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200080    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls podName:77330f26-0bd9-4176-86b7-780fed040b10 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.200067113 +0000 UTC m=+35.751317762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-l4dzs" (UID: "77330f26-0bd9-4176-86b7-780fed040b10") : secret "samples-operator-tls" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.200036    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200092    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.200085882 +0000 UTC m=+35.751336527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : configmap references non-existent config key: service-ca.crt
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200130    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.200116026 +0000 UTC m=+35.751366689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : secret "router-metrics-certs-default" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200137    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200148    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567894c8cd-bksgp: secret "image-registry-tls" not found
Oct 31 00:14:16.202113 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.200170    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls podName:7729e485-91fd-498c-8927-db2c765a9357 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.200163283 +0000 UTC m=+35.751413928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls") pod "image-registry-567894c8cd-bksgp" (UID: "7729e485-91fd-498c-8927-db2c765a9357") : secret "image-registry-tls" not found
Oct 31 00:14:16.288593 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.288564    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-7j8dt" event={"ID":"e0762913-8550-41b9-a1a8-d2df14f88004","Type":"ContainerStarted","Data":"a33ee66e146085d62759b747244264384f5aa7d76eda135d77f81af08381e714"}
Oct 31 00:14:16.289680 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.289659    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" event={"ID":"3734cc90-7907-4498-9a6b-7bae4757ff0b","Type":"ContainerStarted","Data":"e05fc7cc610824cbdb4cd808bb19e74a5de29661e827657f62ae689474d39da8"}
Oct 31 00:14:16.290724 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.290704    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75" event={"ID":"0347cd21-2175-4a7c-8a9c-239cf3b5a392","Type":"ContainerStarted","Data":"daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a"}
Oct 31 00:14:16.291727 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.291708    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzr86" event={"ID":"55ad7d0d-4b43-4377-ab24-9d4768c82cef","Type":"ContainerStarted","Data":"43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b"}
Oct 31 00:14:16.293047 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.293023    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sxf6j" event={"ID":"6bbd3db6-4290-4d6c-9735-519c8585376b","Type":"ContainerStarted","Data":"5373905acd4d530d05d0f5993c9a45019131ca4bdee788465637c7ecc9a826c9"}
Oct 31 00:14:16.293126 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.293057    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sxf6j" event={"ID":"6bbd3db6-4290-4d6c-9735-519c8585376b","Type":"ContainerStarted","Data":"518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2"}
Oct 31 00:14:16.295426 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.295390    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-rt22m" event={"ID":"46f076a2-ab34-4a66-a113-66fa2291345d","Type":"ContainerStarted","Data":"20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa"}
Oct 31 00:14:16.296734 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.296714    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-k6mcf" event={"ID":"9cd937ab-d46d-4bff-8049-485b18bfdb6c","Type":"ContainerStarted","Data":"519876acee4b7a9d29f5309fa234345b9220139fd2886248fd14901a304b7f33"}
Oct 31 00:14:16.296818 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.296746    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-k6mcf" event={"ID":"9cd937ab-d46d-4bff-8049-485b18bfdb6c","Type":"ContainerStarted","Data":"81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf"}
Oct 31 00:14:16.297725 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.297707    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m" event={"ID":"d2b34c50-498f-4371-b594-d3fd404192af","Type":"ContainerStarted","Data":"21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade"}
Oct 31 00:14:16.301176 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.301151    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:16.301290 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.301185    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:16.301290 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.301270    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:16.301394 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.301336    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls podName:aebe9cd7-a93e-4707-b53c-fdaeddc05258 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.301317542 +0000 UTC m=+35.852568203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tlc2z" (UID: "aebe9cd7-a93e-4707-b53c-fdaeddc05258") : secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:16.301394 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.301274    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:16.301394 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.301359    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45469b6c-mczsm: secret "image-registry-tls" not found
Oct 31 00:14:16.301525 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.301399    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls podName:c86b2c1b-dd70-4d49-a5ad-44aaeca443c9 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.301389057 +0000 UTC m=+35.852639715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls") pod "image-registry-7d45469b6c-mczsm" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9") : secret "image-registry-tls" not found
Oct 31 00:14:16.402635 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.402564    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:16.402785 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.402716    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 00:14:16.402785 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:16.402779    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls podName:f53d8e59-7949-41f4-a271-1f6bf7288552 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:18.40276133 +0000 UTC m=+35.954011992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls") pod "dns-default-q5zwx" (UID: "f53d8e59-7949-41f4-a271-1f6bf7288552") : secret "dns-default-metrics-tls" not found
Oct 31 00:14:16.518586 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.518551    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxpcb"]
Oct 31 00:14:16.592602 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.592520    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-7j8dt" podStartSLOduration=330.592485921 podStartE2EDuration="5m30.592485921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:16.591192276 +0000 UTC m=+34.142442944" watchObservedRunningTime="2026-10-31 00:14:16.592485921 +0000 UTC m=+34.143736585"
Oct 31 00:14:16.714005 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.713898    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-sxf6j" podStartSLOduration=330.713883254 podStartE2EDuration="5m30.713883254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:16.712690112 +0000 UTC m=+34.263940781" watchObservedRunningTime="2026-10-31 00:14:16.713883254 +0000 UTC m=+34.265133920"
Oct 31 00:14:16.834371 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:16.833348    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-k6mcf" podStartSLOduration=330.83332727 podStartE2EDuration="5m30.83332727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:16.832866643 +0000 UTC m=+34.384117310" watchObservedRunningTime="2026-10-31 00:14:16.83332727 +0000 UTC m=+34.384577938"
Oct 31 00:14:17.305438 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:17.304681    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxpcb" event={"ID":"e6e98896-64cd-4abd-94ef-a95f65f5d05d","Type":"ContainerStarted","Data":"b76ad395b72caf8d46481fcb1634f79cde8cbdbad2a6f54d018eb00893e8b9ee"}
Oct 31 00:14:18.223283 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.223237    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:18.223449 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.223377    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:18.223573 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.223558    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.223536208 +0000 UTC m=+39.774786869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : configmap references non-existent config key: service-ca.crt
Oct 31 00:14:18.224020 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224000    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 00:14:18.224102 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224059    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert podName:866b4904-8c80-44cf-9912-5de2ccd545b8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.224043777 +0000 UTC m=+39.775294438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-5xjzr" (UID: "866b4904-8c80-44cf-9912-5de2ccd545b8") : secret "networking-console-plugin-cert" not found
Oct 31 00:14:18.224235 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.224207    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:18.224296 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.224262    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:18.224350 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.224328    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:18.224473 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224459    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 00:14:18.224533 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224507    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.224493112 +0000 UTC m=+39.775743776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : secret "router-metrics-certs-default" not found
Oct 31 00:14:18.224595 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224569    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 00:14:18.224648 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224600    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls podName:77330f26-0bd9-4176-86b7-780fed040b10 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.224590179 +0000 UTC m=+39.775840840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-l4dzs" (UID: "77330f26-0bd9-4176-86b7-780fed040b10") : secret "samples-operator-tls" not found
Oct 31 00:14:18.224693 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224671    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:18.224693 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224682    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567894c8cd-bksgp: secret "image-registry-tls" not found
Oct 31 00:14:18.224753 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.224713    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls podName:7729e485-91fd-498c-8927-db2c765a9357 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.224703525 +0000 UTC m=+39.775954188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls") pod "image-registry-567894c8cd-bksgp" (UID: "7729e485-91fd-498c-8927-db2c765a9357") : secret "image-registry-tls" not found
Oct 31 00:14:18.318054 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.318005    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb" event={"ID":"07c85ed3-44fd-4fb8-824f-468184be0d4d","Type":"ContainerStarted","Data":"f824dcaccf3b4e5ff9d47c54b7e30bee67343e131545b2faf4109fb39f771eff"}
Oct 31 00:14:18.325574 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.325526    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:18.325735 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.325592    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:18.325735 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.325689    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:18.325735 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.325703    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45469b6c-mczsm: secret "image-registry-tls" not found
Oct 31 00:14:18.325893 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.325733    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:18.325893 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.325778    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls podName:c86b2c1b-dd70-4d49-a5ad-44aaeca443c9 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.325756087 +0000 UTC m=+39.877006737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls") pod "image-registry-7d45469b6c-mczsm" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9") : secret "image-registry-tls" not found
Oct 31 00:14:18.326002 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.325932    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls podName:aebe9cd7-a93e-4707-b53c-fdaeddc05258 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.325921624 +0000 UTC m=+39.877172275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tlc2z" (UID: "aebe9cd7-a93e-4707-b53c-fdaeddc05258") : secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:18.427740 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:18.426887    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:18.427740 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.427318    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 00:14:18.427740 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:18.427386    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls podName:f53d8e59-7949-41f4-a271-1f6bf7288552 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.427367492 +0000 UTC m=+39.978618151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls") pod "dns-default-q5zwx" (UID: "f53d8e59-7949-41f4-a271-1f6bf7288552") : secret "dns-default-metrics-tls" not found
Oct 31 00:14:20.328449 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:20.328105    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/0.log"
Oct 31 00:14:20.328449 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:20.328153    2586 generic.go:356] "Generic (PLEG): container finished" podID="3734cc90-7907-4498-9a6b-7bae4757ff0b" containerID="bc30141580feefb63cf703353c87e2af1666d9f0ecf071a4274207fac1763cf6" exitCode=255
Oct 31 00:14:20.328449 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:20.328195    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" event={"ID":"3734cc90-7907-4498-9a6b-7bae4757ff0b","Type":"ContainerDied","Data":"bc30141580feefb63cf703353c87e2af1666d9f0ecf071a4274207fac1763cf6"}
Oct 31 00:14:20.329065 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:20.328566    2586 scope.go:122] "RemoveContainer" containerID="bc30141580feefb63cf703353c87e2af1666d9f0ecf071a4274207fac1763cf6"
Oct 31 00:14:20.452585 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:20.452522    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb" podStartSLOduration=301.756527635 podStartE2EDuration="5m4.452502535s" totalImagesPullingTime="2.6959749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:18.440378422 +0000 UTC m=+35.991629092" watchObservedRunningTime="2026-10-31 00:14:20.452502535 +0000 UTC m=+38.003753203"
Oct 31 00:14:21.336005 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.335165    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m" event={"ID":"d2b34c50-498f-4371-b594-d3fd404192af","Type":"ContainerStarted","Data":"aef685df534edbb27bde389796bb12fdc922cf2c95dcfba4a38b028658df4a34"}
Oct 31 00:14:21.344183 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.341175    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27" event={"ID":"171545bb-2c69-4ce1-828c-539f326f1c37","Type":"ContainerStarted","Data":"bdcf06a64994e43d7bffdd5f9be83339982c0bf5cab9d736685cf8b69e844f9d"}
Oct 31 00:14:21.344183 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.343111    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/1.log"
Oct 31 00:14:21.344183 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.343663    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/0.log"
Oct 31 00:14:21.344183 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.343699    2586 generic.go:356] "Generic (PLEG): container finished" podID="3734cc90-7907-4498-9a6b-7bae4757ff0b" containerID="c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d" exitCode=255
Oct 31 00:14:21.344183 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.344067    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" event={"ID":"3734cc90-7907-4498-9a6b-7bae4757ff0b","Type":"ContainerDied","Data":"c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d"}
Oct 31 00:14:21.344183 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.344132    2586 scope.go:122] "RemoveContainer" containerID="bc30141580feefb63cf703353c87e2af1666d9f0ecf071a4274207fac1763cf6"
Oct 31 00:14:21.344900 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.344877    2586 scope.go:122] "RemoveContainer" containerID="c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d"
Oct 31 00:14:21.345188 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:21.345161    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-crbc6_openshift-console-operator(3734cc90-7907-4498-9a6b-7bae4757ff0b)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" podUID="3734cc90-7907-4498-9a6b-7bae4757ff0b"
Oct 31 00:14:21.346385 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.346325    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-rt22m" event={"ID":"46f076a2-ab34-4a66-a113-66fa2291345d","Type":"ContainerStarted","Data":"2550292bbb690679688ad89fe5ad5ef9b3ee2f4293ad222e695e23e752ff089c"}
Oct 31 00:14:21.578241 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.578176    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m" podStartSLOduration=300.077301047 podStartE2EDuration="5m5.578157419s" totalImagesPullingTime="5.500856372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:21.457475626 +0000 UTC m=+39.008726295" watchObservedRunningTime="2026-10-31 00:14:21.578157419 +0000 UTC m=+39.129408087"
Oct 31 00:14:21.702837 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.702733    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-rt22m" podStartSLOduration=301.37459891 podStartE2EDuration="5m6.702713112s" totalImagesPullingTime="5.328114202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:21.580079763 +0000 UTC m=+39.131330432" watchObservedRunningTime="2026-10-31 00:14:21.702713112 +0000 UTC m=+39.253963783"
Oct 31 00:14:21.819431 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.819372    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ww2hz"]
Oct 31 00:14:21.825717 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.824284    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27" podStartSLOduration=301.425935203 podStartE2EDuration="5m6.824266417s" totalImagesPullingTime="5.398331214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:21.822765508 +0000 UTC m=+39.374016177" watchObservedRunningTime="2026-10-31 00:14:21.824266417 +0000 UTC m=+39.375517086"
Oct 31 00:14:21.846258 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.845673    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:21.879858 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.879827    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ww2hz"]
Oct 31 00:14:21.901276 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.901091    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 00:14:21.901276 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.901246    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hcz6l\""
Oct 31 00:14:21.901905 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.901883    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 00:14:21.968809 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.966563    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl5nz\" (UniqueName: \"kubernetes.io/projected/40109db6-b298-4a83-af09-889703196f40-kube-api-access-zl5nz\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:21.968809 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.966614    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:21.968809 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.966685    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:21.968809 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.966767    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40109db6-b298-4a83-af09-889703196f40-data-volume\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:21.968809 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:21.966823    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40109db6-b298-4a83-af09-889703196f40-crio-socket\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067496 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.067455    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40109db6-b298-4a83-af09-889703196f40-data-volume\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067670 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.067548    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40109db6-b298-4a83-af09-889703196f40-crio-socket\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067670 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.067630    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl5nz\" (UniqueName: \"kubernetes.io/projected/40109db6-b298-4a83-af09-889703196f40-kube-api-access-zl5nz\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067670 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.067663    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067820 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.067742    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067872 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.067854    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:22.067928 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.067858    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40109db6-b298-4a83-af09-889703196f40-data-volume\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.067928 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.067916    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.567898962 +0000 UTC m=+40.119149633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:22.068031 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.067963    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 00:14:22.068127 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.068106    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:22.568092014 +0000 UTC m=+40.119342664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : configmap "kube-rbac-proxy" not found
Oct 31 00:14:22.068372 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.068352    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40109db6-b298-4a83-af09-889703196f40-crio-socket\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.091818 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.091791    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-mjrm9-mxnnz"]
Oct 31 00:14:22.114900 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.114875    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.130989 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.130958    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl5nz\" (UniqueName: \"kubernetes.io/projected/40109db6-b298-4a83-af09-889703196f40-kube-api-access-zl5nz\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.149188 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.149163    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-mjrm9-mxnnz"]
Oct 31 00:14:22.168815 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.168790    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.168962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.168826    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.169021 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.168979    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.169158 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.169138    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.269881 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.269802    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:22.269881 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.269850    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.270119 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.269979    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 00:14:22.270119 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270052    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:22.270119 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270093    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert podName:866b4904-8c80-44cf-9912-5de2ccd545b8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.270077125 +0000 UTC m=+47.821327786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-5xjzr" (UID: "866b4904-8c80-44cf-9912-5de2ccd545b8") : secret "networking-console-plugin-cert" not found
Oct 31 00:14:22.270285 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270119    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:22.270285 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270165    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 00:14:22.270285 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270192    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:22.270285 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270225    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls podName:77330f26-0bd9-4176-86b7-780fed040b10 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.270209819 +0000 UTC m=+47.821460504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-l4dzs" (UID: "77330f26-0bd9-4176-86b7-780fed040b10") : secret "samples-operator-tls" not found
Oct 31 00:14:22.270285 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270265    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270287    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270299    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.270287932 +0000 UTC m=+47.821538594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : secret "router-metrics-certs-default" not found
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270326    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270344    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.27033591 +0000 UTC m=+47.821586590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : configmap references non-existent config key: service-ca.crt
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270395    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270429    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270573    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:22.270591 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270589    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567894c8cd-bksgp: secret "image-registry-tls" not found
Oct 31 00:14:22.270961 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.270643    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls podName:7729e485-91fd-498c-8927-db2c765a9357 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.270627802 +0000 UTC m=+47.821878462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls") pod "image-registry-567894c8cd-bksgp" (UID: "7729e485-91fd-498c-8927-db2c765a9357") : secret "image-registry-tls" not found
Oct 31 00:14:22.270961 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270767    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.270961 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270816    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.270961 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.270855    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.334983 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.334949    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.350913 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.350891    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/1.log"
Oct 31 00:14:22.351385 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.351370    2586 scope.go:122] "RemoveContainer" containerID="c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d"
Oct 31 00:14:22.351564 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.351544    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-crbc6_openshift-console-operator(3734cc90-7907-4498-9a6b-7bae4757ff0b)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" podUID="3734cc90-7907-4498-9a6b-7bae4757ff0b"
Oct 31 00:14:22.371475 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.371436    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:22.371622 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.371542    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:22.371622 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.371555    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:22.371622 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.371612    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls podName:aebe9cd7-a93e-4707-b53c-fdaeddc05258 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.371593931 +0000 UTC m=+47.922844590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tlc2z" (UID: "aebe9cd7-a93e-4707-b53c-fdaeddc05258") : secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:22.371808 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.371669    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:22.371808 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.371689    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45469b6c-mczsm: secret "image-registry-tls" not found
Oct 31 00:14:22.371808 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.371745    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls podName:c86b2c1b-dd70-4d49-a5ad-44aaeca443c9 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.371725268 +0000 UTC m=+47.922975999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls") pod "image-registry-7d45469b6c-mczsm" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9") : secret "image-registry-tls" not found
Oct 31 00:14:22.448688 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.448656    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:22.472361 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.472334    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:22.472501 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.472476    2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 00:14:22.472543 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.472535    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls podName:f53d8e59-7949-41f4-a271-1f6bf7288552 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:30.472520343 +0000 UTC m=+48.023770988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls") pod "dns-default-q5zwx" (UID: "f53d8e59-7949-41f4-a271-1f6bf7288552") : secret "dns-default-metrics-tls" not found
Oct 31 00:14:22.522967 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.522900    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"]
Oct 31 00:14:22.537061 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.537034    2586 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"]
Oct 31 00:14:22.537198 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.537162    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:22.539880 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.539857    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:22.572962 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.572932    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.573091 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.573073    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:22.573091 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.573078    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ph4\" (UniqueName: \"kubernetes.io/projected/49c09e8f-95c6-423d-8067-258613cbbe22-kube-api-access-w7ph4\") pod \"migrator-66df5d496b-fx7bx\" (UID: \"49c09e8f-95c6-423d-8067-258613cbbe22\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:22.573194 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.573159    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:22.573231 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.573194    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:23.573172375 +0000 UTC m=+41.124423040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:22.573231 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.573214    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 00:14:22.573317 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.573249    2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpr5s\" (UniqueName: \"kubernetes.io/projected/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2-kube-api-access-zpr5s\") pod \"migrator-66df5d496b-bdcmf\" (UID: \"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:22.573317 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:22.573256    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:23.573244078 +0000 UTC m=+41.124494738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : configmap "kube-rbac-proxy" not found
Oct 31 00:14:22.582514 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.582490    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"]
Oct 31 00:14:22.590941 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.590920    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"]
Oct 31 00:14:22.591449 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.591438    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 00:14:22.591505 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.591442    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jpbc7\""
Oct 31 00:14:22.591505 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.591438    2586 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:22.674939 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.674910    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpr5s\" (UniqueName: \"kubernetes.io/projected/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2-kube-api-access-zpr5s\") pod \"migrator-66df5d496b-bdcmf\" (UID: \"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:22.675114 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.675098    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ph4\" (UniqueName: \"kubernetes.io/projected/49c09e8f-95c6-423d-8067-258613cbbe22-kube-api-access-w7ph4\") pod \"migrator-66df5d496b-fx7bx\" (UID: \"49c09e8f-95c6-423d-8067-258613cbbe22\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:22.740074 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.739372    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpr5s\" (UniqueName: \"kubernetes.io/projected/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2-kube-api-access-zpr5s\") pod \"migrator-66df5d496b-bdcmf\" (UID: \"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:22.740074 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.739833    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ph4\" (UniqueName: \"kubernetes.io/projected/49c09e8f-95c6-423d-8067-258613cbbe22-kube-api-access-w7ph4\") pod \"migrator-66df5d496b-fx7bx\" (UID: \"49c09e8f-95c6-423d-8067-258613cbbe22\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:22.863608 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.863519    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:22.882309 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:22.881816    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:23.105628 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.105597    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-mjrm9-mxnnz"]
Oct 31 00:14:23.108174 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:23.108151    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90debb7c_520b_4a8f_a8ba_dbd1cb11bf5b.slice/crio-227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7 WatchSource:0}: Error finding container 227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7: Status 404 returned error can't find the container with id 227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7
Oct 31 00:14:23.253381 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.253348    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"]
Oct 31 00:14:23.256889 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:23.256861    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c09e8f_95c6_423d_8067_258613cbbe22.slice/crio-55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24 WatchSource:0}: Error finding container 55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24: Status 404 returned error can't find the container with id 55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24
Oct 31 00:14:23.289910 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.289876    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"]
Oct 31 00:14:23.293337 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:23.293312    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3e66be_14ba_4baa_b6fd_bf32374ab3c2.slice/crio-103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3 WatchSource:0}: Error finding container 103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3: Status 404 returned error can't find the container with id 103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3
Oct 31 00:14:23.356454 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.356346    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxpcb" event={"ID":"e6e98896-64cd-4abd-94ef-a95f65f5d05d","Type":"ContainerStarted","Data":"62e22712a39dd13ce754c228129664f78ce278db3ec1798cec97e727576af499"}
Oct 31 00:14:23.356850 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.356530    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:23.357544 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.357520    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx" event={"ID":"49c09e8f-95c6-423d-8067-258613cbbe22","Type":"ContainerStarted","Data":"55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24"}
Oct 31 00:14:23.358643 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.358619    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf" event={"ID":"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2","Type":"ContainerStarted","Data":"103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3"}
Oct 31 00:14:23.360040 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.360017    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz" event={"ID":"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b","Type":"ContainerStarted","Data":"f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32"}
Oct 31 00:14:23.360121 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.360062    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz" event={"ID":"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b","Type":"ContainerStarted","Data":"227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7"}
Oct 31 00:14:23.361448 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.361427    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75" event={"ID":"0347cd21-2175-4a7c-8a9c-239cf3b5a392","Type":"ContainerStarted","Data":"bdff0beae342192344ffb6863a2d7f714d5572f35846bdbbf0d65a93e3952338"}
Oct 31 00:14:23.367623 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.367602    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzr86" event={"ID":"55ad7d0d-4b43-4377-ab24-9d4768c82cef","Type":"ContainerStarted","Data":"541f191fd31c08659cf63b96fbd3f05cf7bcd520b390d4ec787a1ee4ed79bcbf"}
Oct 31 00:14:23.479027 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.478962    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jxpcb" podStartSLOduration=34.258108065 podStartE2EDuration="40.478944203s" totalImagesPullingTime="6.220836138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:23.478894895 +0000 UTC m=+41.030145561" watchObservedRunningTime="2026-10-31 00:14:23.478944203 +0000 UTC m=+41.030194873"
Oct 31 00:14:23.583919 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.583886    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:23.584068 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.584026    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:23.584108 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:23.584028    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:23.584108 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:23.584064    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 00:14:23.584173 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:23.584129    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:25.584110626 +0000 UTC m=+43.135361294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:23.584173 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:23.584144    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:25.584137517 +0000 UTC m=+43.135388162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : configmap "kube-rbac-proxy" not found
Oct 31 00:14:23.601171 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.601126    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75" podStartSLOduration=298.307630816 podStartE2EDuration="5m5.601112994s" totalImagesPullingTime="7.293482178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:23.599817201 +0000 UTC m=+41.151067869" watchObservedRunningTime="2026-10-31 00:14:23.601112994 +0000 UTC m=+41.152363685"
Oct 31 00:14:23.721947 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.721848    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz" podStartSLOduration=1.721836847 podStartE2EDuration="1.721836847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:23.720629222 +0000 UTC m=+41.271879887" watchObservedRunningTime="2026-10-31 00:14:23.721836847 +0000 UTC m=+41.273087558"
Oct 31 00:14:23.841969 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:23.841914    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gzr86" podStartSLOduration=2.52545016 podStartE2EDuration="9.841898972s" totalImagesPullingTime="7.316448812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:23.840991044 +0000 UTC m=+41.392241711" watchObservedRunningTime="2026-10-31 00:14:23.841898972 +0000 UTC m=+41.393149663"
Oct 31 00:14:24.958686 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:24.958651    2586 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:24.959048 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:24.958709    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:24.959048 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:24.959037    2586 scope.go:122] "RemoveContainer" containerID="c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d"
Oct 31 00:14:24.959228 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:24.959209    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-crbc6_openshift-console-operator(3734cc90-7907-4498-9a6b-7bae4757ff0b)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" podUID="3734cc90-7907-4498-9a6b-7bae4757ff0b"
Oct 31 00:14:25.604549 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:25.604513    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:25.604743 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:25.604579    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:25.604743 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:25.604659    2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 00:14:25.604743 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:25.604680    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:25.604743 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:25.604730    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:29.604716777 +0000 UTC m=+47.155967422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:25.604743 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:25.604744    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:29.604738037 +0000 UTC m=+47.155988682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : configmap "kube-rbac-proxy" not found
Oct 31 00:14:26.379644 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:26.379606    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx" event={"ID":"49c09e8f-95c6-423d-8067-258613cbbe22","Type":"ContainerStarted","Data":"81954d3ba2650bdd14108fcef47e7dc6f312a905472370503db71137f9488d12"}
Oct 31 00:14:26.381084 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:26.381057    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf" event={"ID":"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2","Type":"ContainerStarted","Data":"059fb4790009aa5bcecf81b3ddcd024eebd96f8247104b4b0a3dacd68b8ea872"}
Oct 31 00:14:26.458823 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:26.458797    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6cjm6_6a6dde53-407d-43ce-84df-30c1a1e08580/dns-node-resolver/0.log"
Oct 31 00:14:26.498743 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:26.498693    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx" podStartSLOduration=1.830110881 podStartE2EDuration="4.498680295s" totalImagesPullingTime="2.668569414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:26.497335947 +0000 UTC m=+44.048586614" watchObservedRunningTime="2026-10-31 00:14:26.498680295 +0000 UTC m=+44.049930962"
Oct 31 00:14:26.624069 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:26.624020    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf" podStartSLOduration=1.9891013100000001 podStartE2EDuration="4.624004958s" totalImagesPullingTime="2.634903648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:26.623157581 +0000 UTC m=+44.174408248" watchObservedRunningTime="2026-10-31 00:14:26.624004958 +0000 UTC m=+44.175255624"
Oct 31 00:14:27.658588 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:27.658557    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vxfn8_7d998f53-1c5a-4144-880c-4c69c558ab97/node-ca/0.log"
Oct 31 00:14:28.259586 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:28.259552    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzr86_55ad7d0d-4b43-4377-ab24-9d4768c82cef/serve-healthcheck-canary/0.log"
Oct 31 00:14:28.659657 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:28.659625    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-bdcmf_2d3e66be-14ba-4baa-b6fd-bf32374ab3c2/migrator/0.log"
Oct 31 00:14:28.858798 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:28.858770    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-fx7bx_49c09e8f-95c6-423d-8067-258613cbbe22/migrator/0.log"
Oct 31 00:14:29.060498 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:29.060397    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m_d2b34c50-498f-4371-b594-d3fd404192af/kube-storage-version-migrator-operator/0.log"
Oct 31 00:14:29.641889 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:29.641853    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:29.642073 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:29.641916    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:29.642073 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:29.642013    2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:29.642073 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:29.642065    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls podName:40109db6-b298-4a83-af09-889703196f40 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:37.642052807 +0000 UTC m=+55.193303453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ww2hz" (UID: "40109db6-b298-4a83-af09-889703196f40") : secret "insights-runtime-extractor-tls" not found
Oct 31 00:14:29.642380 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:29.642360    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:30.348217 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.348183    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.348307    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.348350    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348365    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.3483444 +0000 UTC m=+63.899595060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : configmap references non-existent config key: service-ca.crt
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.348401    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348454    2586 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.348494    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348495    2586 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348519    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348534    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567894c8cd-bksgp: secret "image-registry-tls" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348537    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls podName:77330f26-0bd9-4176-86b7-780fed040b10 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.348503146 +0000 UTC m=+63.899753802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-l4dzs" (UID: "77330f26-0bd9-4176-86b7-780fed040b10") : secret "samples-operator-tls" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348577    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert podName:866b4904-8c80-44cf-9912-5de2ccd545b8 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.348563456 +0000 UTC m=+63.899814106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-5xjzr" (UID: "866b4904-8c80-44cf-9912-5de2ccd545b8") : secret "networking-console-plugin-cert" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348581    2586 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348601    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls podName:7729e485-91fd-498c-8927-db2c765a9357 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.348591878 +0000 UTC m=+63.899842530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls") pod "image-registry-567894c8cd-bksgp" (UID: "7729e485-91fd-498c-8927-db2c765a9357") : secret "image-registry-tls" not found
Oct 31 00:14:30.348710 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.348651    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs podName:b899807e-b82b-4d93-b1b7-ce371ff91281 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.34863797 +0000 UTC m=+63.899888635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs") pod "router-default-7c7d9879df-g4m8t" (UID: "b899807e-b82b-4d93-b1b7-ce371ff91281") : secret "router-metrics-certs-default" not found
Oct 31 00:14:30.449164 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.449128    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:30.449164 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.449162    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:30.449365 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.449270    2586 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:30.449365 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.449312    2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 00:14:30.449365 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.449323    2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45469b6c-mczsm: secret "image-registry-tls" not found
Oct 31 00:14:30.449365 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.449329    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls podName:aebe9cd7-a93e-4707-b53c-fdaeddc05258 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.449315604 +0000 UTC m=+64.000566249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tlc2z" (UID: "aebe9cd7-a93e-4707-b53c-fdaeddc05258") : secret "cluster-monitoring-operator-tls" not found
Oct 31 00:14:30.449365 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:30.449358    2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls podName:c86b2c1b-dd70-4d49-a5ad-44aaeca443c9 nodeName:}" failed. No retries permitted until 2026-10-31 00:14:46.449348688 +0000 UTC m=+64.000599336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls") pod "image-registry-7d45469b6c-mczsm" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9") : secret "image-registry-tls" not found
Oct 31 00:14:30.550090 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.550056    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:30.552314 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.552291    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:30.674483 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:30.674369    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:31.045461 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:31.045372    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5zwx"]
Oct 31 00:14:31.048338 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:31.048310    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53d8e59_7949_41f4_a271_1f6bf7288552.slice/crio-1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35 WatchSource:0}: Error finding container 1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35: Status 404 returned error can't find the container with id 1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35
Oct 31 00:14:31.396713 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:31.396681    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5zwx" event={"ID":"f53d8e59-7949-41f4-a271-1f6bf7288552","Type":"ContainerStarted","Data":"1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35"}
Oct 31 00:14:32.088868 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.088838    2586 scope.go:122] "RemoveContainer" containerID="c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d"
Oct 31 00:14:32.401195 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.401130    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:14:32.401603 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.401523    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/1.log"
Oct 31 00:14:32.401603 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.401554    2586 generic.go:356] "Generic (PLEG): container finished" podID="3734cc90-7907-4498-9a6b-7bae4757ff0b" containerID="e32c1e9962b8bdb8999894dc8ef08c56b51990162f0f6407b6ee968ae7f74493" exitCode=255
Oct 31 00:14:32.401676 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.401631    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" event={"ID":"3734cc90-7907-4498-9a6b-7bae4757ff0b","Type":"ContainerDied","Data":"e32c1e9962b8bdb8999894dc8ef08c56b51990162f0f6407b6ee968ae7f74493"}
Oct 31 00:14:32.401708 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.401690    2586 scope.go:122] "RemoveContainer" containerID="c3711969c488bc81ad3a39cba072b50d4606d0c3659c3c1acf6256fcc652c73d"
Oct 31 00:14:32.401972 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:32.401941    2586 scope.go:122] "RemoveContainer" containerID="e32c1e9962b8bdb8999894dc8ef08c56b51990162f0f6407b6ee968ae7f74493"
Oct 31 00:14:32.402149 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:32.402129    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-crbc6_openshift-console-operator(3734cc90-7907-4498-9a6b-7bae4757ff0b)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" podUID="3734cc90-7907-4498-9a6b-7bae4757ff0b"
Oct 31 00:14:33.407279 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:33.407253    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:14:34.411646 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.411612    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5zwx" event={"ID":"f53d8e59-7949-41f4-a271-1f6bf7288552","Type":"ContainerStarted","Data":"11bc8a606c398baa3370195dea935598066ddb9a4747880cb04a3ce47e8e5f64"}
Oct 31 00:14:34.412135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.411660    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5zwx" event={"ID":"f53d8e59-7949-41f4-a271-1f6bf7288552","Type":"ContainerStarted","Data":"b769bcadbc63390e9f2ae203a29420aaccdd346dea814aaa726dea833de1302b"}
Oct 31 00:14:34.412135 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.411735    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:34.535466 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.535396    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-q5zwx" podStartSLOduration=17.898161351 podStartE2EDuration="20.535380011s" totalImagesPullingTime="2.63721866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:34.534100663 +0000 UTC m=+52.085351330" watchObservedRunningTime="2026-10-31 00:14:34.535380011 +0000 UTC m=+52.086630677"
Oct 31 00:14:34.958168 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.958132    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:34.958333 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.958194    2586 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:34.958523 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:34.958508    2586 scope.go:122] "RemoveContainer" containerID="e32c1e9962b8bdb8999894dc8ef08c56b51990162f0f6407b6ee968ae7f74493"
Oct 31 00:14:34.958713 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:34.958691    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-crbc6_openshift-console-operator(3734cc90-7907-4498-9a6b-7bae4757ff0b)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" podUID="3734cc90-7907-4498-9a6b-7bae4757ff0b"
Oct 31 00:14:37.716392 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:37.716355    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:37.718577 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:37.718556    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:37.810448 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:37.810407    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:38.238337 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:38.238307    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ww2hz"]
Oct 31 00:14:38.241297 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:38.241272    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40109db6_b298_4a83_af09_889703196f40.slice/crio-720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895 WatchSource:0}: Error finding container 720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895: Status 404 returned error can't find the container with id 720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895
Oct 31 00:14:38.427005 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:38.426970    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww2hz" event={"ID":"40109db6-b298-4a83-af09-889703196f40","Type":"ContainerStarted","Data":"b843a5e6c06a9d672bd3d9f54895f1c64ef5cbba0b24c0d070ba380a9253b134"}
Oct 31 00:14:38.427168 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:38.427028    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww2hz" event={"ID":"40109db6-b298-4a83-af09-889703196f40","Type":"ContainerStarted","Data":"720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895"}
Oct 31 00:14:39.599703 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:39.599676    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:40.434393 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:40.434356    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww2hz" event={"ID":"40109db6-b298-4a83-af09-889703196f40","Type":"ContainerStarted","Data":"cfed2bc9643f8766611b27c32c283eb531aff6af5d0711a023f8789ac83b9af6"}
Oct 31 00:14:42.444156 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:42.444109    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ww2hz" event={"ID":"40109db6-b298-4a83-af09-889703196f40","Type":"ContainerStarted","Data":"e828051d0870644574ecc15cb772e9b49063bb0877f13863c05e660cc088cfe1"}
Oct 31 00:14:42.573311 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:42.573260    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ww2hz" podStartSLOduration=17.991111498 podStartE2EDuration="21.573246744s" totalImagesPullingTime="3.582135246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:14:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:42.572139002 +0000 UTC m=+60.123389670" watchObservedRunningTime="2026-10-31 00:14:42.573246744 +0000 UTC m=+60.124497411"
Oct 31 00:14:44.417115 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:44.417082    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:44.530908 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:44.530875    2586 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d45469b6c-mczsm"]
Oct 31 00:14:44.531063 ip-10-0-140-47 kubenswrapper[2586]: E1031 00:14:44.531041    2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7d45469b6c-mczsm" podUID="c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"
Oct 31 00:14:45.452583 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.452545    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:45.458700 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.458678    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:45.584661 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584623    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.584829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584675    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.584829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584710    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.584829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584749    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.584829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584786    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.584829 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584826    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.585077 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584917    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:45.585077 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.584950    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:14:45.585251 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.585231    2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-ca-trust-extracted\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:45.585390 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.585244    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:14:45.585390 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.585368    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:14:45.586967 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.586942    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:14:45.586967 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.586958    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "kube-api-access-nppnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:14:45.587102 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.587013    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:14:45.587141 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.587107    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:14:45.686499 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.686464    2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-image-registry-private-configuration\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:45.686499 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.686493    2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-certificates\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:45.686676 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.686507    2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-bound-sa-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:45.686676 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.686521    2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-trusted-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:45.686676 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.686533    2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nppnw\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-kube-api-access-nppnw\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:45.686676 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:45.686547    2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-installation-pull-secrets\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:46.392569 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.392535    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:46.392569 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.392573    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:46.392795 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.392625    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:46.392795 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.392660    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:46.392795 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.392749    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:46.393428 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.393383    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:46.395253 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.395224    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:46.395253 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.395247    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:46.395617 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.395595    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:46.395617 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.395608    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:46.455476 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.455448    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:46.493534 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.493504    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:46.493707 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.493540    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:46.496012 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.495981    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:46.496110 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.495981    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"image-registry-7d45469b6c-mczsm\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") " pod="openshift-image-registry/image-registry-7d45469b6c-mczsm"
Oct 31 00:14:46.541154 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.541127    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:46.595786 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.595754    2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") pod \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\" (UID: \"c86b2c1b-dd70-4d49-a5ad-44aaeca443c9\") "
Oct 31 00:14:46.602996 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.602922    2586 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls" pod "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" (UID: "c86b2c1b-dd70-4d49-a5ad-44aaeca443c9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:14:46.615997 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.615976    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pk6r6\""
Oct 31 00:14:46.623288 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.623269    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:46.668508 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.667927    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkrjn\""
Oct 31 00:14:46.673038 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.673007    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:46.695556 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.695525    2586 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d45469b6c-mczsm"]
Oct 31 00:14:46.696468 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.696448    2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9-registry-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:14:46.698800 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.698755    2586 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d45469b6c-mczsm"]
Oct 31 00:14:46.712293 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.712267    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-gndw5\""
Oct 31 00:14:46.719499 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.719474    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:46.773561 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.773536    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z2qz5\""
Oct 31 00:14:46.781294 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.781244    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:46.916274 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.916246    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"]
Oct 31 00:14:46.999703 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:46.999676    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567894c8cd-bksgp"]
Oct 31 00:14:47.002443 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:47.002407    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7729e485_91fd_498c_8927_db2c765a9357.slice/crio-c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd WatchSource:0}: Error finding container c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd: Status 404 returned error can't find the container with id c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd
Oct 31 00:14:47.054384 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.054361    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c7d9879df-g4m8t"]
Oct 31 00:14:47.056775 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:47.056753    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb899807e_b82b_4d93_b1b7_ce371ff91281.slice/crio-ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4 WatchSource:0}: Error finding container ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4: Status 404 returned error can't find the container with id ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4
Oct 31 00:14:47.093889 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.093865    2586 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c86b2c1b-dd70-4d49-a5ad-44aaeca443c9" path="/var/lib/kubelet/pods/c86b2c1b-dd70-4d49-a5ad-44aaeca443c9/volumes"
Oct 31 00:14:47.096496 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.096477    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"]
Oct 31 00:14:47.098658 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:47.098634    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866b4904_8c80_44cf_9912_5de2ccd545b8.slice/crio-71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479 WatchSource:0}: Error finding container 71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479: Status 404 returned error can't find the container with id 71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479
Oct 31 00:14:47.151301 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.151269    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"]
Oct 31 00:14:47.154657 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:47.154634    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebe9cd7_a93e_4707_b53c_fdaeddc05258.slice/crio-67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541 WatchSource:0}: Error finding container 67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541: Status 404 returned error can't find the container with id 67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541
Oct 31 00:14:47.459490 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.459450    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr" event={"ID":"866b4904-8c80-44cf-9912-5de2ccd545b8","Type":"ContainerStarted","Data":"71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479"}
Oct 31 00:14:47.460979 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.460946    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c7d9879df-g4m8t" event={"ID":"b899807e-b82b-4d93-b1b7-ce371ff91281","Type":"ContainerStarted","Data":"fdd3fe4fbdfed5be6bc0053cf5ee98a08febb077580b453713527d3e25c0b51f"}
Oct 31 00:14:47.461110 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.460997    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c7d9879df-g4m8t" event={"ID":"b899807e-b82b-4d93-b1b7-ce371ff91281","Type":"ContainerStarted","Data":"ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4"}
Oct 31 00:14:47.462124 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.462105    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs" event={"ID":"77330f26-0bd9-4176-86b7-780fed040b10","Type":"ContainerStarted","Data":"0e4712aeb6b09cf3dc71e969ddedb80ae150d5c4ab80c9be7c585f0799f18fca"}
Oct 31 00:14:47.463143 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.463117    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z" event={"ID":"aebe9cd7-a93e-4707-b53c-fdaeddc05258","Type":"ContainerStarted","Data":"67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541"}
Oct 31 00:14:47.464551 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.464530    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567894c8cd-bksgp" event={"ID":"7729e485-91fd-498c-8927-db2c765a9357","Type":"ContainerStarted","Data":"ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c"}
Oct 31 00:14:47.464648 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.464563    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567894c8cd-bksgp" event={"ID":"7729e485-91fd-498c-8927-db2c765a9357","Type":"ContainerStarted","Data":"c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd"}
Oct 31 00:14:47.464722 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.464645    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:47.673999 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.673963    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:47.676213 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.676186    2586 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:47.711006 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.710929    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-567894c8cd-bksgp" podStartSLOduration=63.710916564 podStartE2EDuration="1m3.710916564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:13:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:47.710591428 +0000 UTC m=+65.261842103" watchObservedRunningTime="2026-10-31 00:14:47.710916564 +0000 UTC m=+65.262167230"
Oct 31 00:14:47.711888 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.711846    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/router-default-7c7d9879df-g4m8t" podStartSLOduration=332.711835593 podStartE2EDuration="5m32.711835593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:47.585689119 +0000 UTC m=+65.136939786" watchObservedRunningTime="2026-10-31 00:14:47.711835593 +0000 UTC m=+65.263086260"
Oct 31 00:14:47.908430 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.908390    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:47.908567 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.908456    2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:47.961717 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.961643    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:14:47.961717 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.961669    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:14:47.971047 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.971019    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:47.971152 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:47.971019    2586 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:48.277334 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.277262    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zk5sj\""
Oct 31 00:14:48.284451 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.284427    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:48.286302 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.286278    2586 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lg2hb\""
Oct 31 00:14:48.293646 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.293587    2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:48.468859 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.468811    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:48.470096 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.470046    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:48.710659 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.710626    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-65fz2"]
Oct 31 00:14:48.715727 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:48.715695    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6362fc09_4b02_49dd_8e75_db40d935cc71.slice/crio-38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec WatchSource:0}: Error finding container 38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec: Status 404 returned error can't find the container with id 38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec
Oct 31 00:14:48.762818 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:48.762783    2586 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5725k"]
Oct 31 00:14:48.766334 ip-10-0-140-47 kubenswrapper[2586]: W1031 00:14:48.766302    2586 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c43a258_8b6a_4d05_a56f_dfd659fc37d8.slice/crio-7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a WatchSource:0}: Error finding container 7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a: Status 404 returned error can't find the container with id 7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a
Oct 31 00:14:49.479536 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:49.479494    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr" event={"ID":"866b4904-8c80-44cf-9912-5de2ccd545b8","Type":"ContainerStarted","Data":"23479af573cd41e0e5524dbbcfeab5f9082a25757c2ce8bbf15cbd7c959d0419"}
Oct 31 00:14:49.480960 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:49.480923    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-65fz2" event={"ID":"6362fc09-4b02-49dd-8e75-db40d935cc71","Type":"ContainerStarted","Data":"38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec"}
Oct 31 00:14:49.482180 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:49.482154    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5725k" event={"ID":"4c43a258-8b6a-4d05-a56f-dfd659fc37d8","Type":"ContainerStarted","Data":"7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a"}
Oct 31 00:14:49.599579 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:49.599525    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr" podStartSLOduration=323.752883859 podStartE2EDuration="5m25.599505576s" totalImagesPullingTime="1.846621717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:49.598104394 +0000 UTC m=+67.149355074" watchObservedRunningTime="2026-10-31 00:14:49.599505576 +0000 UTC m=+67.150756244"
Oct 31 00:14:50.490968 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:50.490537    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs" event={"ID":"77330f26-0bd9-4176-86b7-780fed040b10","Type":"ContainerStarted","Data":"cb2990e854a3020c8c9497dfce32235a002a9540d4302ea7843b32f9b2ad9757"}
Oct 31 00:14:50.490968 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:50.490651    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs" event={"ID":"77330f26-0bd9-4176-86b7-780fed040b10","Type":"ContainerStarted","Data":"cbb262ce3cac8b5283e775eb6a71c0eac5cbd68d8cac19615260026eb21a7ffc"}
Oct 31 00:14:50.658382 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:50.658322    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs" podStartSLOduration=354.388749021 podStartE2EDuration="5m57.658302324s" totalImagesPullingTime="3.269553303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:50.657864099 +0000 UTC m=+68.209114762" watchObservedRunningTime="2026-10-31 00:14:50.658302324 +0000 UTC m=+68.209552993"
Oct 31 00:14:51.494654 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:51.494618    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z" event={"ID":"aebe9cd7-a93e-4707-b53c-fdaeddc05258","Type":"ContainerStarted","Data":"f2a8d5029011006769c526c4a684502a0e7356ffa227706c20bc817ffd4b2178"}
Oct 31 00:14:51.496480 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:51.496458    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5725k" event={"ID":"4c43a258-8b6a-4d05-a56f-dfd659fc37d8","Type":"ContainerStarted","Data":"23ff265fac33766601bbeba95a7406eb9572b76b92c322b3a0bcb53f8db5bbf0"}
Oct 31 00:14:51.496579 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:51.496502    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5725k" event={"ID":"4c43a258-8b6a-4d05-a56f-dfd659fc37d8","Type":"ContainerStarted","Data":"384264ab35a66856ec4da89fada8f9a601f4d5c4f14a5dffe45d2f927457640e"}
Oct 31 00:14:51.616487 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:51.616432    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z" podStartSLOduration=333.103802393 podStartE2EDuration="5m36.616402055s" totalImagesPullingTime="3.512599662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:51.615156251 +0000 UTC m=+69.166406917" watchObservedRunningTime="2026-10-31 00:14:51.616402055 +0000 UTC m=+69.167652723"
Oct 31 00:14:51.737477 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:51.737400    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5725k" podStartSLOduration=66.88693699 podStartE2EDuration="1m8.737385885s" totalImagesPullingTime="1.850448895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:51.737333155 +0000 UTC m=+69.288583823" watchObservedRunningTime="2026-10-31 00:14:51.737385885 +0000 UTC m=+69.288636552"
Oct 31 00:14:54.374138 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:54.374105    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:56.089218 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:56.089184    2586 scope.go:122] "RemoveContainer" containerID="e32c1e9962b8bdb8999894dc8ef08c56b51990162f0f6407b6ee968ae7f74493"
Oct 31 00:14:56.518960 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:56.518885    2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:14:56.519119 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:56.518986    2586 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" event={"ID":"3734cc90-7907-4498-9a6b-7bae4757ff0b","Type":"ContainerStarted","Data":"1dcd37fa59cf1a5459bf764c3512546554110cb66381ff6749e2c586ce9d7bc7"}
Oct 31 00:14:56.519785 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:56.519757    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:56.642281 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:56.642222    2586 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6" podStartSLOduration=336.333136008 podStartE2EDuration="5m40.642198944s" totalImagesPullingTime="4.309062936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:14:56.640222972 +0000 UTC m=+74.191473638" watchObservedRunningTime="2026-10-31 00:14:56.642198944 +0000 UTC m=+74.193449610"
Oct 31 00:14:57.163192 ip-10-0-140-47 kubenswrapper[2586]: I1031 00:14:57.163124    2586 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:58.250771 ip-10-0-140-47 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 00:14:58.261821 ip-10-0-140-47 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 00:14:58.261998 ip-10-0-140-47 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 00:14:58.262050 ip-10-0-140-47 systemd[1]: kubelet.service: Consumed 4.633s CPU time.
Oct 31 00:14:58.272237 ip-10-0-140-47 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 00:14:58.362076 ip-10-0-140-47 kubenswrapper[5925]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:14:58.362076 ip-10-0-140-47 kubenswrapper[5925]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 00:14:58.362076 ip-10-0-140-47 kubenswrapper[5925]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:14:58.362076 ip-10-0-140-47 kubenswrapper[5925]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:14:58.364553 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364465    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.364553 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364548    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.364553 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364553    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.364553 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364557    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.364553 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364561    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364566    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364570    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364574    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364578    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364582    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364585    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364589    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364592    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364596    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364600    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364604    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364610    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364616    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364621    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364625    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364629    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364633    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364637    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.364900 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364641    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364645    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364650    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364654    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364659    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364662    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364674    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364678    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364683    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364687    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364699    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364703    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364708    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364713    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364718    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364724    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364729    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364734    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364738    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364742    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.365820 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364747    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364751    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364755    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364760    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364764    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364768    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364772    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364777    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364781    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364786    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364790    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364795    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364799    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364803    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364809    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364813    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364818    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364822    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364827    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.366741 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364831    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364835    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364840    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364845    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364849    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364854    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364859    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364864    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364868    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364873    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364877    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364881    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364886    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364890    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364895    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364899    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364903    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364907    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364911    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.367618 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364917    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364924    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364931    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364937    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364944    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364948    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364953    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364958    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364962    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364966    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364971    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364976    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364980    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364985    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364989    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364993    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.364997    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365002    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365007    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.368570 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365022    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365027    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365031    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365036    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365040    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.365044    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366310    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366321    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366326    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366331    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366335    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366340    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366344    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366349    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366355    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366360    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366364    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366369    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366373    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366378    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.369485 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366382    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366387    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366391    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366396    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366400    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366404    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366409    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366431    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366436    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366440    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366444    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366449    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366454    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366458    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366463    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366469    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366475    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366480    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366485    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.370405 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366490    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366494    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366498    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366503    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366507    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366512    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366516    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366521    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366526    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366531    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366535    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366540    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366544    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366549    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366553    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366558    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366564    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366569    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366573    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.371143 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366578    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366582    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366587    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366591    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366595    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366600    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366604    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366608    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366613    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366617    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366622    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366626    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366631    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366635    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366640    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366644    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366649    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366653    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366657    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366662    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.371659 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366666    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366671    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366676    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366680    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366684    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366688    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366693    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366697    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366701    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366705    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366709    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366714    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366719    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366723    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366728    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366734    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366739    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366748    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366752    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.372168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366756    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366760    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366765    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366769    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366774    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366778    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366783    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366787    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366792    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366796    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366800    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366807    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366811    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366815    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.366820    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367651    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367662    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367666    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367671    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367675    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.372706 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367679    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367684    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367688    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367693    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367698    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367703    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367707    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367711    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367716    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367720    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367725    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367729    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367733    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367738    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367743    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367747    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367752    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367756    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367760    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367764    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.373224 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367781    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367786    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367791    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367795    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367800    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367804    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367808    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367812    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367818    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367822    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367827    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367831    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367836    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367840    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367845    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367850    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367854    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367858    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367862    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.373749 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367866    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367871    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367876    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367881    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367885    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367889    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367894    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367898    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367903    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367907    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367911    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367915    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367920    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367924    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367928    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367933    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367937    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367942    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367946    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367951    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.374228 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367955    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367959    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367964    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367968    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367972    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367977    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367981    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367985    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367990    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367994    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.367998    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368002    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368008    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368012    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368017    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368022    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368026    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368033    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368039    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368044    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.374760 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368048    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368052    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368057    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368064    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368070    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368075    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368079    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368084    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368088    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368092    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368097    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368101    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368106    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368110    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368114    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368120    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368125    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368129    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368133    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.375283 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368138    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368149    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.368154    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368294    5925 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368310    5925 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368320    5925 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368328    5925 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368334    5925 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368340    5925 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368347    5925 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368354    5925 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368359    5925 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368364    5925 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368369    5925 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368375    5925 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368380    5925 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368385    5925 flags.go:64] FLAG: --cgroup-root=""
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368390    5925 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368395    5925 flags.go:64] FLAG: --client-ca-file=""
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368399    5925 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368404    5925 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368432    5925 flags.go:64] FLAG: --cluster-domain=""
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368437    5925 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 00:14:58.375775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368442    5925 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368448    5925 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368453    5925 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368459    5925 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368464    5925 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368469    5925 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368475    5925 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368480    5925 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368485    5925 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368490    5925 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368498    5925 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368503    5925 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368510    5925 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368515    5925 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368523    5925 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368528    5925 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368533    5925 flags.go:64] FLAG: --enable-server="true"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368538    5925 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368544    5925 flags.go:64] FLAG: --event-burst="100"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368549    5925 flags.go:64] FLAG: --event-qps="50"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368554    5925 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368559    5925 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368564    5925 flags.go:64] FLAG: --eviction-hard=""
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368571    5925 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 00:14:58.376346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368575    5925 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368580    5925 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368585    5925 flags.go:64] FLAG: --eviction-soft=""
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368590    5925 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368594    5925 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368599    5925 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368605    5925 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368610    5925 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368614    5925 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368619    5925 flags.go:64] FLAG: --feature-gates=""
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368627    5925 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368632    5925 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368637    5925 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368642    5925 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368647    5925 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368653    5925 flags.go:64] FLAG: --help="false"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368658    5925 flags.go:64] FLAG: --hostname-override="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368664    5925 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368669    5925 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368674    5925 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368680    5925 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368685    5925 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368698    5925 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 00:14:58.376977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368703    5925 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368708    5925 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368713    5925 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368718    5925 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368723    5925 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368728    5925 flags.go:64] FLAG: --kube-reserved=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368733    5925 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368737    5925 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368742    5925 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368747    5925 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368752    5925 flags.go:64] FLAG: --lock-file=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368757    5925 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368762    5925 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368767    5925 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368776    5925 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368780    5925 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368785    5925 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368790    5925 flags.go:64] FLAG: --logging-format="text"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368794    5925 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368800    5925 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368805    5925 flags.go:64] FLAG: --manifest-url=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368810    5925 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368817    5925 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368822    5925 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368828    5925 flags.go:64] FLAG: --max-pods="110"
Oct 31 00:14:58.377593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368834    5925 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368839    5925 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368844    5925 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368848    5925 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368854    5925 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368859    5925 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368866    5925 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368877    5925 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368882    5925 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368887    5925 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368892    5925 flags.go:64] FLAG: --pod-cidr=""
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368897    5925 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368902    5925 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368906    5925 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368911    5925 flags.go:64] FLAG: --port="10250"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368916    5925 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368921    5925 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-06c856e59653b3c7a"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368927    5925 flags.go:64] FLAG: --qos-reserved=""
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368931    5925 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368936    5925 flags.go:64] FLAG: --register-node="true"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368941    5925 flags.go:64] FLAG: --register-with-taints=""
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368948    5925 flags.go:64] FLAG: --registry-burst="10"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368952    5925 flags.go:64] FLAG: --registry-qps="5"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368957    5925 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368961    5925 flags.go:64] FLAG: --reserved-memory=""
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368968    5925 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 00:14:58.378216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368973    5925 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368978    5925 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368983    5925 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368988    5925 flags.go:64] FLAG: --runonce="false"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368993    5925 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.368998    5925 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369003    5925 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369009    5925 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369013    5925 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369018    5925 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369023    5925 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369028    5925 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369036    5925 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369041    5925 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369045    5925 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369050    5925 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369055    5925 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369060    5925 flags.go:64] FLAG: --system-cgroups=""
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369065    5925 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369074    5925 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369079    5925 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369083    5925 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369091    5925 flags.go:64] FLAG: --tls-min-version=""
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369095    5925 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369100    5925 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 00:14:58.379152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369104    5925 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369109    5925 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369114    5925 flags.go:64] FLAG: --v="2"
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369121    5925 flags.go:64] FLAG: --version="false"
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369128    5925 flags.go:64] FLAG: --vmodule=""
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369137    5925 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369142    5925 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369359    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369365    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369370    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369374    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369379    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369383    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369388    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369392    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369404    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369409    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369429    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369434    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369441    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369445    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.379787 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369449    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369454    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369461    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369467    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369472    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369476    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369481    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369485    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369489    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369493    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369498    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369502    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369508    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369514    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369519    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369524    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369530    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369535    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369539    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.380347 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369543    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369548    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369552    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369557    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369561    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369566    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369570    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369575    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369587    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369592    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369596    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369602    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369607    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369611    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369616    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369620    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369624    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369629    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369633    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.380880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369637    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369642    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369646    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369651    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369655    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369660    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369665    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369669    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369673    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369678    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369684    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369688    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369692    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369697    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369701    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369706    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369710    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369714    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369718    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369723    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.381728 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369727    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369731    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369744    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369748    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369755    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369759    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369763    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369767    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369771    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369776    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369780    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369785    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369789    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369793    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369798    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369802    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369806    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369811    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369815    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.382308 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369819    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369824    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369828    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369835    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369839    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369843    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369848    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369852    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369856    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369860    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369864    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369869    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369873    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369877    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369882    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.369923    5925 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:14:58.382805 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369980    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369990    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369995    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.369999    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370004    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370009    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370013    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370017    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370022    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370026    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370030    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370034    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370039    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370043    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370047    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370052    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370056    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370060    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370065    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.383208 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370069    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370076    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370080    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370084    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370088    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370093    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370098    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370102    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370106    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370110    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370115    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370120    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370124    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370128    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370135    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370139    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370144    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370149    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370153    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370157    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.383689 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370162    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370166    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370170    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370174    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370179    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370183    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370188    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370192    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370196    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370200    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370205    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370209    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370213    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370219    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370224    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370228    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370232    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370237    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370242    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.384167 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370246    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370250    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370255    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370262    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370269    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370275    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370280    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370286    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370292    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370296    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370300    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370305    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370309    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370315    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370321    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370327    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370331    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370336    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370340    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.384680 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370344    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370349    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370353    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370358    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370363    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370368    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370372    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370378    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370382    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370387    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370391    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370395    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370400    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370403    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370408    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370427    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370432    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370436    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370440    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370444    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.385160 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370456    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370461    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370467    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370472    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370477    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370481    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370487    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370492    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.370496    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.374405    5925 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.374442    5925 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.374461    5925 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.374466    5925 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374526    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374531    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374534    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374537    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374541    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374545    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.385865 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374548    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374551    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374554    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374557    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374560    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374563    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374566    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374568    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374571    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374574    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374577    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374579    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374582    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374585    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374588    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374591    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374594    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374597    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374600    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374602    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.386343 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374605    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374608    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374611    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374613    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374616    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374619    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374622    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374624    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374627    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374630    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374632    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374635    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374638    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374640    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374643    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374645    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374649    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374653    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374656    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.386903 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374659    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374662    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374665    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374668    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374671    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374674    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374677    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374679    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374682    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374685    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374688    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374691    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374693    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374696    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374699    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374701    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374704    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374707    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374709    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374712    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.387547 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374715    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374717    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374720    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374722    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374725    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374727    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374730    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374733    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374735    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374738    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374740    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374744    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374747    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374749    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374752    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374755    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374757    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374760    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374762    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374765    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.388203 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374768    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374771    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374774    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374777    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374780    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374782    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374785    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374787    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374790    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374792    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374795    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374798    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374800    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374803    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374805    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374808    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374811    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374813    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374816    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.388909 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374819    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374821    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.374847    5925 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374993    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.374998    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375001    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375004    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375007    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375010    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375013    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375016    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375018    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375021    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375023    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375026    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.389691 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375028    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375031    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375034    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375037    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375039    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375042    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375044    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375047    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375049    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375052    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375054    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375057    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375060    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375063    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375065    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375068    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375071    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375073    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375076    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.390096 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375078    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375081    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375084    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375087    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375089    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375092    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375094    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375097    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375100    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375102    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375105    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375108    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375110    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375113    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375115    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375118    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375121    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375123    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375126    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375128    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.390578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375131    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375134    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375136    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375139    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375143    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375147    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375150    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375153    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375155    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375158    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375161    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375163    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375166    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375168    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375171    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375174    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375177    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375179    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375182    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.391117 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375185    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375187    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375190    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375192    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375195    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375197    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375200    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375204    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375206    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375209    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375212    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375214    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375217    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375219    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375223    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375227    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375230    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375233    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375236    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.391599 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375239    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375242    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375244    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375247    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375249    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375252    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375254    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375257    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375260    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375263    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375265    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375268    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375270    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375273    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375275    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375278    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.392378 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375280    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.375303    5925 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375336    5925 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375340    5925 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375343    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375345    5925 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375348    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375351    5925 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375354    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375357    5925 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375359    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375362    5925 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375365    5925 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375368    5925 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375370    5925 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375373    5925 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:14:58.392817 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375376    5925 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375378    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375381    5925 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375385    5925 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375389    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375392    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375395    5925 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375398    5925 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375401    5925 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375403    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375406    5925 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375409    5925 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375425    5925 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375430    5925 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375434    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375438    5925 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375442    5925 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375446    5925 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375451    5925 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:14:58.393241 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375455    5925 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375459    5925 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375463    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375466    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375469    5925 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375472    5925 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375475    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375478    5925 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375480    5925 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375483    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375486    5925 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375488    5925 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375491    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375494    5925 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375496    5925 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375499    5925 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375501    5925 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375504    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375506    5925 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375509    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:14:58.393766 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375512    5925 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375517    5925 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375520    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375523    5925 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375525    5925 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375528    5925 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375531    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375533    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375536    5925 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375538    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375542    5925 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375547    5925 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375550    5925 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375553    5925 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375555    5925 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375558    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375561    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375563    5925 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375567    5925 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:14:58.394264 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375569    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375572    5925 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375575    5925 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375578    5925 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375580    5925 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375583    5925 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375585    5925 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375588    5925 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375591    5925 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375593    5925 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375596    5925 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375599    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375601    5925 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375604    5925 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375608    5925 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375610    5925 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375613    5925 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375616    5925 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375618    5925 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375621    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:14:58.394853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375623    5925 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375626    5925 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375630    5925 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375633    5925 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375637    5925 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375640    5925 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375643    5925 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375645    5925 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375648    5925 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375650    5925 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375653    5925 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375657    5925 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375660    5925 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:14:58.375662    5925 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.375710    5925 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.376654    5925 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.376724    5925 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.376910    5925 server.go:1014] "Starting client certificate rotation"
Oct 31 00:14:58.395362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.377051    5925 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.377098    5925 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:08:42 +0000 UTC" deadline="2028-06-12 20:22:15.563775157 +0000 UTC"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.377135    5925 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14180h7m17.186642014s"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.377374    5925 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.378388    5925 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.380350    5925 log.go:25] "Validated CRI v1 runtime API"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.383118    5925 log.go:25] "Validated CRI v1 image API"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.383844    5925 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 00:14:58.395830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.386169    5925 fs.go:135] Filesystem UUIDs: map[19bea397-d12c-4855-8c30-33df1709958d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ab9533b9-0c7e-4712-80d1-2c6e77413809:/dev/nvme0n1p3]
Oct 31 00:14:58.396083 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.386190    5925 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e4712aeb6b09cf3dc71e969ddedb80ae150d5c4ab80c9be7c585f0799f18fca/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e4712aeb6b09cf3dc71e969ddedb80ae150d5c4ab80c9be7c585f0799f18fca/userdata/shm major:0 minor:406 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3/userdata/shm major:0 minor:329 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35/userdata/shm major:0 minor:360 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7/userdata/shm major:0 minor:317 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec/userdata/shm major:0 minor:445 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24/userdata/shm major:0 minor:327 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541/userdata/shm major:0 minor:413 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479/userdata/shm major:0 minor:411 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895/userdata/shm major:0 minor:384 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a/userdata/shm major:0 minor:443 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/917b5535e248c79ff0ed7de0a6d24f3782ccceac59d7f7ac3d5aeeee0238df11/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/917b5535e248c79ff0ed7de0a6d24f3782ccceac59d7f7ac3d5aeeee0238df11/userdata/shm major:0 minor:217 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b76ad395b72caf8d46481fcb1634f79cde8cbdbad2a6f54d018eb00893e8b9ee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b76ad395b72caf8d46481fcb1634f79cde8cbdbad2a6f54d018eb00893e8b9ee/userdata/shm major:0 minor:287 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd/userdata/shm major:0 minor:405 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4/userdata/shm major:0 minor:409 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e05fc7cc610824cbdb4cd808bb19e74a5de29661e827657f62ae689474d39da8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e05fc7cc610824cbdb4cd808bb19e74a5de29661e827657f62ae689474d39da8/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0347cd21-2175-4a7c-8a9c-239cf3b5a392/volumes/kubernetes.io~projected/kube-api-access-49spz:{mountpoint:/var/lib/kubelet/pods/0347cd21-2175-4a7c-8a9c-239cf3b5a392/volumes/kubernetes.io~projected/kube-api-access-49spz major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07c85ed3-44fd-4fb8-824f-468184be0d4d/volumes/kubernetes.io~projected/kube-api-access-2dq55:{mountpoint:/var/lib/kubelet/pods/07c85ed3-44fd-4fb8-824f-468184be0d4d/volumes/kubernetes.io~projected/kube-api-access-2dq55 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/171545bb-2c69-4ce1-828c-539f326f1c37/volumes/kubernetes.io~projected/kube-api-access-5qb9k:{mountpoint:/var/lib/kubelet/pods/171545bb-2c69-4ce1-828c-539f326f1c37/volumes/kubernetes.io~projected/kube-api-access-5qb9k major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/171545bb-2c69-4ce1-828c-539f326f1c37/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/171545bb-2c69-4ce1-828c-539f326f1c37/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2/volumes/kubernetes.io~projected/kube-api-access-zpr5s:{mountpoint:/var/lib/kubelet/pods/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2/volumes/kubernetes.io~projected/kube-api-access-zpr5s major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3734cc90-7907-4498-9a6b-7bae4757ff0b/volumes/kubernetes.io~projected/kube-api-access-v8m4c:{mountpoint:/var/lib/kubelet/pods/3734cc90-7907-4498-9a6b-7bae4757ff0b/volumes/kubernetes.io~projected/kube-api-access-v8m4c major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3734cc90-7907-4498-9a6b-7bae4757ff0b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/3734cc90-7907-4498-9a6b-7bae4757ff0b/volumes/kubernetes.io~secret/serving-cert major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40109db6-b298-4a83-af09-889703196f40/volumes/kubernetes.io~projected/kube-api-access-zl5nz:{mountpoint:/var/lib/kubelet/pods/40109db6-b298-4a83-af09-889703196f40/volumes/kubernetes.io~projected/kube-api-access-zl5nz major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40109db6-b298-4a83-af09-889703196f40/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/40109db6-b298-4a83-af09-889703196f40/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:380 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/462389b8-254c-4f99-ac14-5b66525f62dd/volumes/kubernetes.io~projected/kube-api-access-qr2f5:{mountpoint:/var/lib/kubelet/pods/462389b8-254c-4f99-ac14-5b66525f62dd/volumes/kubernetes.io~projected/kube-api-access-qr2f5 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46929db8-c3de-4e58-90e3-3099456b9018/volumes/kubernetes.io~projected/kube-api-access-n9s7h:{mountpoint:/var/lib/kubelet/pods/46929db8-c3de-4e58-90e3-3099456b9018/volumes/kubernetes.io~projected/kube-api-access-n9s7h major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46f076a2-ab34-4a66-a113-66fa2291345d/volumes/kubernetes.io~projected/kube-api-access-97f5b:{mountpoint:/var/lib/kubelet/pods/46f076a2-ab34-4a66-a113-66fa2291345d/volumes/kubernetes.io~projected/kube-api-access-97f5b major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/46f076a2-ab34-4a66-a113-66fa2291345d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/46f076a2-ab34-4a66-a113-66fa2291345d/volumes/kubernetes.io~secret/serving-cert major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/49c09e8f-95c6-423d-8067-258613cbbe22/volumes/kubernetes.io~projected/kube-api-access-w7ph4:{mountpoint:/var/lib/kubelet/pods/49c09e8f-95c6-423d-8067-258613cbbe22/volumes/kubernetes.io~projected/kube-api-access-w7ph4 major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c43a258-8b6a-4d05-a56f-dfd659fc37d8/volumes/kubernetes.io~projected/kube-api-access-942jl:{mountpoint:/var/lib/kubelet/pods/4c43a258-8b6a-4d05-a56f-dfd659fc37d8/volumes/kubernetes.io~projected/kube-api-access-942jl major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c43a258-8b6a-4d05-a56f-dfd659fc37d8/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/4c43a258-8b6a-4d05-a56f-dfd659fc37d8/volumes/kubernetes.io~secret/metrics-certs major:0 minor:441 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55ad7d0d-4b43-4377-ab24-9d4768c82cef/volumes/kubernetes.io~projected/kube-api-access-4j7ml:{mountpoint:/var/lib/kubelet/pods/55ad7d0d-4b43-4377-ab24-9d4768c82cef/volumes/kubernetes.io~projected/kube-api-access-4j7ml major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55ad7d0d-4b43-4377-ab24-9d4768c82cef/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/55ad7d0d-4b43-4377-ab24-9d4768c82cef/volumes/kubernetes.io~secret/cert major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5/volumes/kubernetes.io~secret/agent-certs major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6362fc09-4b02-49dd-8e75-db40d935cc71/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/6362fc09-4b02-49dd-8e75-db40d935cc71/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a6dde53-407d-43ce-84df-30c1a1e08580/volumes/kubernetes.io~projected/kube-api-access-lf7ph:{mountpoint:/var/lib/kubelet/pods/6a6dde53-407d-43ce-84df-30c1a1e08580/volumes/kubernetes.io~projected/kube-api-access-lf7ph major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bbd3db6-4290-4d6c-9735-519c8585376b/volumes/kubernetes.io~projected/kube-api-access-mw5d5:{mountpoint:/var/lib/kubelet/pods/6bbd3db6-4290-4d6c-9735-519c8585376b/volumes/kubernetes.io~projected/kube-api-access-mw5d5 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volumes/kubernetes.io~projected/kube-api-access-nkgkm:{mountpoint:/var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volumes/kubernetes.io~projected/kube-api-access-nkgkm major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/kube-api-access-jrbks:{mountpoint:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/kube-api-access-jrbks major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/registry-tls:{mountpoint:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/registry-tls major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77330f26-0bd9-4176-86b7-780fed040b10/volumes/kubernetes.io~projected/kube-api-access-mdpmc:{mountpoint:/var/lib/kubelet/pods/77330f26-0bd9-4176-86b7-780fed040b10/volumes/kubernetes.io~projected/kube-api-access-mdpmc major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/77330f26-0bd9-4176-86b7-780fed040b10/volumes/kubernetes.io~secret/samples-operator-tls:{mountpoint:/var/lib/kubelet/pods/77330f26-0bd9-4176-86b7-780fed040b10/volumes/kubernetes.io~secret/samples-operator-tls major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d998f53-1c5a-4144-880c-4c69c558ab97/volumes/kubernetes.io~projected/kube-api-access-5ht4s:{mountpoint:/var/lib/kubelet/pods/7d998f53-1c5a-4144-880c-4c69c558ab97/volumes/kubernetes.io~projected/kube-api-access-5ht4s major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/866b4904-8c80-44cf-9912-5de2ccd545b8/volumes/kubernetes.io~secret/networking-console-plugin-cert:{mountpoint:/var/lib/kubelet/pods/866b4904-8c80-44cf-9912-5de2ccd545b8/volumes/kubernetes.io~secret/networking-console-plugin-cert major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b/volumes/kubernetes.io~projected/kube-api-access-2grhx:{mountpoint:/var/lib/kubelet/pods/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b/volumes/kubernetes.io~projected/kube-api-access-2grhx major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9cd937ab-d46d-4bff-8049-485b18bfdb6c/volumes/kubernetes.io~projected/kube-api-access-m8lrp:{mountpoint:/var/lib/kubelet/pods/9cd937ab-d46d-4bff-8049-485b18bfdb6c/volumes/kubernetes.io~projected/kube-api-access-m8lrp major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~projected/kube-api-access-mkc48:{mountpoint:/var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~projected/kube-api-access-mkc48 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aebe9cd7-a93e-4707-b53c-fdaeddc05258/volumes/kubernetes.io~projected/kube-api-access-jxbln:{mountpoint:/var/lib/kubelet/pods/aebe9cd7-a93e-4707-b53c-fdaeddc05258/volumes/kubernetes.io~projected/kube-api-access-jxbln major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aebe9cd7-a93e-4707-b53c-fdaeddc05258/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls:{mountpoint:/var/lib/kubelet/pods/aebe9cd7-a93e-4707-b53c-fdaeddc05258/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls major:0 minor:401 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~projected/kube-api-access-l4zv5:{mountpoint:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~projected/kube-api-access-l4zv5 major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/default-certificate major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/metrics-certs major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/stats-auth major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb/volumes/kubernetes.io~projected/kube-api-access-k9z2m:{mountpoint:/var/lib/kubelet/pods/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb/volumes/kubernetes.io~projected/kube-api-access-k9z2m major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2b34c50-498f-4371-b594-d3fd404192af/volumes/kubernetes.io~projected/kube-api-access-6cgd7:{mountpoint:/var/lib/kubelet/pods/d2b34c50-498f-4371-b594-d3fd404192af/volumes/kubernetes.io~projected/kube-api-access-6cgd7 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d2b34c50-498f-4371-b594-d3fd404192af/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d2b34c50-498f-4371-b594-d3fd404192af/volumes/kubernetes.io~secret/serving-cert major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d4205e63-79f8-4bda-861a-5402609c037f/volumes/kubernetes.io~projected/kube-api-access-swqp8:{mountpoint:/var/lib/kubelet/pods/d4205e63-79f8-4bda-861a-5402609c037f/volumes/kubernetes.io~projected/kube-api-access-swqp8 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e0762913-8550-41b9-a1a8-d2df14f88004/volumes/kubernetes.io~projected/kube-api-access-qrlst:{mountpoint:/var/lib/kubelet/pods/e0762913-8550-41b9-a1a8-d2df14f88004/volumes/kubernetes.io~projected/kube-api-access-qrlst major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e6e98896-64cd-4abd-94ef-a95f65f5d05d/volumes/kubernetes.io~projected/kube-api-access-7sgxj:{mountpoint:/var/lib/kubelet/pods/e6e98896-64cd-4abd-94ef-a95f65f5d05d/volumes/kubernetes.io~projected/kube-api-access-7sgxj major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f53d8e59-7949-41f4-a271-1f6bf7288552/volumes/kubernetes.io~projected/kube-api-access-jq9s6:{mountpoint:/var/lib/kubelet/pods/f53d8e59-7949-41f4-a271-1f6bf7288552/volumes/kubernetes.io~projected/kube-api-access-jq9s6 major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f53d8e59-7949-41f4-a271-1f6bf7288552/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/f53d8e59-7949-41f4-a271-1f6bf7288552/volumes/kubernetes.io~secret/metrics-tls major:0 minor:359 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/feffa800a384fe3e5ee843d707b707f8cd6e2137a01cfeb52b36c219f1673ad3/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/bf430363038e0efee1b9b1d07060ae7b2b0ed13f7702a5181e8aaba86d26f169/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/ef79aa7dfe0ad139d20615f331231173f01904ab440f8550395221c3d78628f0/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/6e3a715aa38dd52d0450577bf886f42437a9d5b3b120f9e18bc29c6bf29bb9d4/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/a5e049171e0ce0026157f32cd55006a4c9e74ddd7e712d26cf8a9df19a7f7254/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-113:{mountpoint:/var/lib/containers/storage/overlay/46c98d3ddf7d56ad057c735d58033c7045dedae7a8d8f7458050b7fd4626d65e/merged major:0 minor:113 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/a6c53e7d437960471f31445ea99d61fe24d189497b511ab5575da271dda41bac/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/dde6658e93573555d3af2d2dd8334b7e830cabd8ad8d07938667a6f9506bc7d1/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/6c871bf15061ecf444871f358b4c37231540c065a966b5a00feef830e61d9cff/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/094fde26dde1edbaa6d506fdba6e737357ab5b61a1e6bf656444a89ba838ecf7/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/06ae11fa9bfed71bfd3b7e05efa0ef9b7ace605e3583681ce67394b5f96e0df0/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/1988d9819c2f2aea1c8af266db2c4ab9ed61ec725da9ad1b17505427e8f392e4/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/279bd58109eedcc023335ea25e454d7785d43d41e055736d767d46e98f4a4039/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/fbdebb80b8870c4a340298ddbfd6085b7384550c3d38c0e75104caca36c0864f/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/44d060cec60e26b9ed844286f4a852af24907a20d23b728472c4714ac3b07c4b/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/3dd33eec5c8338f0c82f4b9e73f598caea660108c3f31ad8ba44be58bf4ac927/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/af078700943e18aa647db4a70053d429c9e6658dac2d738b3e9286d46c15ef0e/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/3d4770e769bae1f5855d40d5cc5081ca7c95251e2fbfd574a83343b34cb51707/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/1a82d4e1f20259797ba1e967bc1bba2327b409fd7a300f1fae4b3200323bb231/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/0075ff62175a6fc534a1d465d523c88a51f64644eedd626abbda886117022e39/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/bed0df433911e2ee6eb3adeb600a0847d207a629c872e0dac12dc2ac97dcb65e/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/de8910bb15b227aa9b0c926f82297852601a345ca53da734313459c7e674f58d/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/0a3d4b18156c49d0082efa8cdf4eaf3ab3af37a8ba0f291009622fd3cd2ecef6/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/c2f9c39a0e08f80282f4a7cd0924b29f0dfbf444fbed395a28f50f3fc6a7ebf8/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/053bbf42d63d58ff232969011286f8a82d5cbc2a0fafec43e7eb87f4737bb6ae/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/0f5dd8f8a0480c21a779ca0273a007d83f52ffe678848c73152f98178773d5f0/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-261:{mountpoint:/var/lib/containers/storage/overlay/c1a96560a1d0a7984d9cd33270b5113857d57dff59e7210ff69e03eda032e02e/merged major:0 minor:261 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/178a7afb0dcdb7350864397ef6916efd30956d978733b458a93dc67ee1df0839/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/ee8434ab99aa15f44ffc60beb8dc52e053ee161e0db102aa19192e83b8428c1a/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/1b92e353ba9b8df624883a66a8c559235a3f75e7914a6df35be67eadf49c54e5/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-270:{mountpoint:/var/lib/containers/storage/overlay/818f14a990b634cf4be403159ed1aafb14cbac08afc7934673604a1ea46fa360/merged major:0 minor:270 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/fb2dcc9429c3736c237431f931a7ae02c3ee845870d7975321f3ca3fb98d1ec0/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/933ddd4acc3e592c5d6fe998264983e221a5df974a9fdf798c10aff517a7d6c8/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/f7714dbab2d89396150891b80fc824fc6ad6ad986d61b6d222e0d6413f8e1d6f/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-289:{mountpoint:/var/lib/containers/storage/overlay/2c94b5cbf47b4d37456e1c3f2edbe1f0f2442efc684a2240e7b8bd1bc13f79e0/merged major:0 minor:289 fsType:overlay blockSize:0} overlay_0-291:{mountpoint:/var/lib/containers/storage/overlay/d2a39f1a86f8e6506cf04ac60cae8e53ab5303b48e1221b48d448f58339e5e80/merged major:0 minor:291 fsType:overlay blockSize:0} overlay_0-293:{mountpoint:/var/lib/containers/storage/overlay/f2415e0b11043798638be059d6f6a0e5e886935d88d401484423b96951fec710/merged major:0 minor:293 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/b7e95a5b0f216626da3255f2d9a553d8ed0450103391085d6e5ee6fb3d0bffc1/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/c37b4190b24731b4b366dd8c3e304621315f27d73e3c4d8c23e7a167d31c33dd/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-321:{mountpoint:/var/lib/containers/storage/overlay/4859964c5cd8c51fc6711d484b9ae12250eee3131368a76250c679aedabf57ca/merged major:0 minor:321 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/74b317ef7a04c2e6730b709037d118ad80c075164940147b150a36ffd4829a6c/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/d91ee9299e957f054b8ed5e81c2f5979c067bb8969dff5ad9f04bd20138407d0/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-343:{mountpoint:/var/lib/containers/storage/overlay/053c111957bb839e51a9d3c665409d0d84881fa0e42bdf243eb2f8d2ecb5569e/merged major:0 minor:343 fsType:overlay blockSize:0} overlay_0-345:{mountpoint:/var/lib/containers/storage/overlay/c3e9d8f9de76c3285ebb7976e2abf7cf7144a54622a34f0997a329c8af8a400f/merged major:0 minor:345 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/c41de17cf478895a4be3a8f620afe0e387e6bb4da75b7ee84d8730f18cbc1b24/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/846693455d49fc5671f9b6c8631e55042bb5ef5fe715d73959328e8002a0c774/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-355:{mountpoint:/var/lib/containers/storage/overlay/c26367117341462974447cc2cd54fc8e3670b2b05be1766434a79926eb9b3769/merged major:0 minor:355 fsType:overlay blockSize:0} overlay_0-357:{mountpoint:/var/lib/containers/storage/overlay/eafedd84e771bf6c038ec32804b6efe662a858aef7d1824df41a5af6ff599282/merged major:0 minor:357 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/a53ff11995b4ff6ff1d699658bfad87298530cc608ac766d5a96ba212c312ae0/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/8c8c564d49e971db76f893025e507b4f520b34297f4bffa0cdd21a53e574147d/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/241fa065de753425e6073266163ef9ebe17a29068f543f2b0d36b80d06f5b837/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/8b4574e8e7c04af21871046e48592d4a414727a1c2f6e82be4d9020365c5d47d/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/bbf37914843f07acd5b5707206a0eba86bc9daf888331d2ae7584505296d6325/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/bdf32cec3a04d7a0ba6bbc7e837c2d99a31e8699137437da1ad408fd67a9e894/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/24e420e8b3bd6d89369fb8b7d4d686837ff5505d80ed872baf89f8be5c711fcc/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-415:{mountpoint:/var/lib/containers/storage/overlay/bf7eb4a70f867442ce276306fc55f0724219f80853734206989f1c5f6923733e/merged major:0 minor:415 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/e449dd2e35238b6e250c99447c6aa9ec1f4df3916908951832aec44acdb0efcd/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-423:{mountpoint:/var/lib/containers/storage/overlay/2c5d3a66b0341c875b8ab04d0e9f7386959f539d0c65a424fa0bb85241b06bcd/merged major:0 minor:423 fsType:overlay blockSize:0} overlay_0-425:{mountpoint:/var/lib/containers/storage/overlay/c9bf51b56a871ba269dc79c23568c520a3dc2639ebfb595cab3093a39247b548/merged major:0 minor:425 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/67696db00273c4e5a8f56ddaea48307eb53752eabe790c3dff62f6c297bec5cd/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/bc7714db0130c785760e1512c757b0197422db991f49d2419609690f34bbb338/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-434:{mountpoint:/var/lib/containers/storage/overlay/d1dc31847e75e803666d30ae737554a099142c2e7063e828d0bd4582afeedded/merged major:0 minor:434 fsType:overlay blockSize:0} overlay_0-447:{mountpoint:/var/lib/containers/storage/overlay/adffd9e16e0d6fd89b852472f0441ea7e15cd433c39a6401ab9d710ddabbe4a0/merged major:0 minor:447 fsType:overlay blockSize:0} overlay_0-449:{mountpoint:/var/lib/containers/storage/overlay/c3d817535c1ab5f59e2adb49a494e9bedf3aa1f7bc748f8aef529f04a64540c7/merged major:0 minor:449 fsType:overlay blockSize:0} overlay_0-451:{mountpoint:/var/lib/containers/storage/overlay/503ad649673690b64995cdb0b87f5feeb7f406257ec40411ba9b274485447026/merged major:0 minor:451 fsType:overlay blockSize:0} overlay_0-453:{mountpoint:/var/lib/containers/storage/overlay/99a6dac358157179b17028dfdf7870821643c22562c290bed2407884d5852f55/merged major:0 minor:453 fsType:overlay blockSize:0} overlay_0-459:{mountpoint:/var/lib/containers/storage/overlay/ed9fffb3166ff8ee68b0feae15b856367390bde2f5f2743b6fe4dfb439a8fda9/merged major:0 minor:459 fsType:overlay blockSize:0} overlay_0-464:{mountpoint:/var/lib/containers/storage/overlay/58de8d19203f87b630876b4f99a591039eaf6f5829aef029449dc3a7c895b9b9/merged major:0 minor:464 fsType:overlay blockSize:0} overlay_0-469:{mountpoint:/var/lib/containers/storage/overlay/d527b6779c7e90c679da32753bc29fe04674a106fa400250c2d3a8294d365f6b/merged major:0 minor:469 fsType:overlay blockSize:0} overlay_0-471:{mountpoint:/var/lib/containers/storage/overlay/eaaecd1499540fb79ba0811c3e664c4cd15ab56ca784c04ff5214975a9d5f57f/merged major:0 minor:471 fsType:overlay blockSize:0} overlay_0-481:{mountpoint:/var/lib/containers/storage/overlay/5ab9374e102ef76f0eb9da93f1993774d526e5124839886b731c11dd655739a6/merged major:0 minor:481 fsType:overlay blockSize:0} overlay_0-486:{mountpoint:/var/lib/containers/storage/overlay/d9266a186099f1d15ca5b59a77498b37a3af450e4553ad8f9a5adabaaf6f373c/merged major:0 minor:486 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/0751f9bf5701bfd3ffeb12afddf662e01c46cfb5cd0dc27f65b2b4f2aeb6cecb/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/18aceee11af2121ea1794ef1c966193d140632c8af075bde09cc53d5cf0ddaa0/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/8214b6e2f55314f23bb68f6f296dd22bfcb9b7357192d0eb13421fb48f76ef76/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/1f0059b8b088a2e64a32527d71cfe8151e71cdc0e59941f96468e9f52a169e95/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/3fcec52409d115a804dbc3cdbea69c1ca132a8cadc1c9debea0b1011eb1b7a01/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/a589956545363116123d1e224063f57613f00cf1535fd6781b61db808788fa09/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/fafcd65405260f0870a3b4b335bd01a6de027289a9196b225e312bf318764152/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/6036a6b95b5266fa04422c5d294222fadfba83466d4326dbc9a3ad3c278259e4/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/df86a353f93dd0444486288e0dc7e77e97cfe85581bf67c14bdc2661a02a06f9/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/13cefedd7361864d325e8955c25e4999b0b878cc97789772ef41c366664928ca/merged major:0 minor:98 fsType:overlay blockSize:0}]
Oct 31 00:14:58.396389 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.395972    5925 manager.go:217] Machine: {Timestamp:2026-10-31 00:14:58.395482253 +0000 UTC m=+0.084362192 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102241 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b67e0b3579e16975f418941330597 SystemUUID:ec2b67e0-b357-9e16-975f-418941330597 BootID:af774ea2-fe6e-41ff-98a4-c1491720f78d Filesystems:[{Device:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-425 DeviceMajor:0 DeviceMinor:425 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-261 DeviceMajor:0 DeviceMinor:261 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e4712aeb6b09cf3dc71e969ddedb80ae150d5c4ab80c9be7c585f0799f18fca/userdata/shm DeviceMajor:0 DeviceMinor:406 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd/userdata/shm DeviceMajor:0 DeviceMinor:405 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-459 DeviceMajor:0 DeviceMinor:459 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7d998f53-1c5a-4144-880c-4c69c558ab97/volumes/kubernetes.io~projected/kube-api-access-5ht4s DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/462389b8-254c-4f99-ac14-5b66525f62dd/volumes/kubernetes.io~projected/kube-api-access-qr2f5 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1be4735e63a0d4fd154f04250b5865f27d8526d253682b74f2df608b0b6e3f35/userdata/shm DeviceMajor:0 DeviceMinor:360 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ba12a3464c1bef5a6f8eb56c116c69f21af772f18a25c0747eb9df8d414998a/userdata/shm DeviceMajor:0 DeviceMinor:443 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1c59b2faf315c0d57ccd5c029f4b63bb0f5f46214e89e97736f6c5daa044a542/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/aebe9cd7-a93e-4707-b53c-fdaeddc05258/volumes/kubernetes.io~projected/kube-api-access-jxbln DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/55172ee5882240b4a2a6768eb2261607338430fada02e592fe497d0b703e8a24/userdata/shm DeviceMajor:0 DeviceMinor:327 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-423 DeviceMajor:0 DeviceMinor:423 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-486 DeviceMajor:0 DeviceMinor:486 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d4205e63-79f8-4bda-861a-5402609c037f/volumes/kubernetes.io~projected/kube-api-access-swqp8 DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/49c09e8f-95c6-423d-8067-258613cbbe22/volumes/kubernetes.io~projected/kube-api-access-w7ph4 DeviceMajor:0 DeviceMinor:320 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/40109db6-b298-4a83-af09-889703196f40/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:380 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-451 DeviceMajor:0 DeviceMinor:451 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e6e98896-64cd-4abd-94ef-a95f65f5d05d/volumes/kubernetes.io~projected/kube-api-access-7sgxj DeviceMajor:0 DeviceMinor:282 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~projected/kube-api-access-mkc48 DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/966ecb6ec5485694058b561126d82a79ac641ee942b4aa1248bdc591fbde196d/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-113 DeviceMajor:0 DeviceMinor:113 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d2b34c50-498f-4371-b594-d3fd404192af/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-289 DeviceMajor:0 DeviceMinor:289 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~projected/kube-api-access-l4zv5 DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6bbd3db6-4290-4d6c-9735-519c8585376b/volumes/kubernetes.io~projected/kube-api-access-mw5d5 DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/0347cd21-2175-4a7c-8a9c-239cf3b5a392/volumes/kubernetes.io~projected/kube-api-access-49spz DeviceMajor:0 DeviceMinor:235 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-355 DeviceMajor:0 DeviceMinor:355 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/67424bc9b8b04a1b8bbdffdae9b705e2b1382bedb3a515b4d0a6995fe053c541/userdata/shm DeviceMajor:0 DeviceMinor:413 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ce570bb954decbe3c0b339015336cc850817e51cb7691285787ec153d0e702b4/userdata/shm DeviceMajor:0 DeviceMinor:409 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-345 DeviceMajor:0 DeviceMinor:345 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/866b4904-8c80-44cf-9912-5de2ccd545b8/volumes/kubernetes.io~secret/networking-console-plugin-cert DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/registry-tls DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07c85ed3-44fd-4fb8-824f-468184be0d4d/volumes/kubernetes.io~projected/kube-api-access-2dq55 DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-447 DeviceMajor:0 DeviceMinor:447 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-453 DeviceMajor:0 DeviceMinor:453 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6103e24fcd1682dc0f7a1cd68a30980646c3168e8e8035a64ea03f3974657a49/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e0762913-8550-41b9-a1a8-d2df14f88004/volumes/kubernetes.io~projected/kube-api-access-qrlst DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/b899807e-b82b-4d93-b1b7-ce371ff91281/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4c43a258-8b6a-4d05-a56f-dfd659fc37d8/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:441 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/917b5535e248c79ff0ed7de0a6d24f3782ccceac59d7f7ac3d5aeeee0238df11/userdata/shm DeviceMajor:0 DeviceMinor:217 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-293 DeviceMajor:0 DeviceMinor:293 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2/volumes/kubernetes.io~projected/kube-api-access-zpr5s DeviceMajor:0 DeviceMinor:319 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/720456d099682ee271b7d0826fc7bcd80f1a4c254832b60a94d9da9101cd1895/userdata/shm DeviceMajor:0 DeviceMinor:384 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20fbc4a20277fc41b6ca2738a50cfd3ce5d9dfd36b6c4d328d1d2ee0a9aa33fa/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f53d8e59-7949-41f4-a271-1f6bf7288552/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:359 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6362fc09-4b02-49dd-8e75-db40d935cc71/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:442 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-449 DeviceMajor:0 DeviceMinor:449 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2f13806698a73907dfabea4f8c82d37704af47f1d71958d861ef842b2307841b/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b/volumes/kubernetes.io~projected/kube-api-access-2grhx DeviceMajor:0 DeviceMinor:316 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-464 DeviceMajor:0 DeviceMinor:464 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-481 DeviceMajor:0 DeviceMinor:481 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77330f26-0bd9-4176-86b7-780fed040b10/volumes/kubernetes.io~projected/kube-api-access-mdpmc DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/40109db6-b298-4a83-af09-889703196f40/volumes/kubernetes.io~projected/kube-api-access-zl5nz DeviceMajor:0 DeviceMinor:311 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/103381988e5bf892c24474dae0d53e378e552109835c4220e18b4c6ea19bdad3/userdata/shm DeviceMajor:0 DeviceMinor:329 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-415 DeviceMajor:0 DeviceMinor:415 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52ccddba8a1ed8a4f145bf74f045d617b398c852a02b3e852ebc17772f2f5feb/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8b87c659ab140547b06e13e56a87d9b3d1829e92f0e453f10c1c933a8de690ac/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3734cc90-7907-4498-9a6b-7bae4757ff0b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f53d8e59-7949-41f4-a271-1f6bf7288552/volumes/kubernetes.io~projected/kube-api-access-jq9s6 DeviceMajor:0 DeviceMinor:234 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7/userdata/shm DeviceMajor:0 DeviceMinor:317 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-357 DeviceMajor:0 DeviceMinor:357 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/171545bb-2c69-4ce1-828c-539f326f1c37/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-291 DeviceMajor:0 DeviceMinor:291 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aebe9cd7-a93e-4707-b53c-fdaeddc05258/volumes/kubernetes.io~secret/cluster-monitoring-operator-tls DeviceMajor:0 DeviceMinor:401 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-469 DeviceMajor:0 DeviceMinor:469 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/kube-api-access-jrbks DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e05fc7cc610824cbdb4cd808bb19e74a5de29661e827657f62ae689474d39da8/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/21f0e9594491b52b782168bf12732650e0c027e3d228687fe46a19aa5df9cade/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-321 DeviceMajor:0 DeviceMinor:321 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-434 DeviceMajor:0 DeviceMinor:434 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-270 DeviceMajor:0 DeviceMinor:270 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb/volumes/kubernetes.io~projected/kube-api-access-k9z2m DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/55ad7d0d-4b43-4377-ab24-9d4768c82cef/volumes/kubernetes.io~projected/kube-api-access-4j7ml DeviceMajor:0 DeviceMinor:236 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/3734cc90-7907-4498-9a6b-7bae4757ff0b/volumes/kubernetes.io~projected/kube-api-access-v8m4c DeviceMajor:0 DeviceMinor:237 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/43c5e4b229009c7c5bc4426323ab87aa473f77bc1601934424e62f46f0745b5b/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e27e6415a5ad7f4df8264cf9c54c901ee663cfc9312e015b039615f42749b8c5/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/53fea5fe6249d9de67e4c945f37aed8af80c18009f35299981515678f028d90d/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9cd937ab-d46d-4bff-8049-485b18bfdb6c/volumes/kubernetes.io~projected/kube-api-access-m8lrp DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/81be44842c4c8224900f9e8268595e706a55630adee5d31350d0558dd660f5bf/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-343 DeviceMajor:0 DeviceMinor:343 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/77330f26-0bd9-4176-86b7-780fed040b10/volumes/kubernetes.io~secret/samples-operator-tls DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/223a8080eeedbab10430646feee3fb7425484df7c07a71867e5a0d487125bc40/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/46f076a2-ab34-4a66-a113-66fa2291345d/volumes/kubernetes.io~projected/kube-api-access-97f5b DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/55ad7d0d-4b43-4377-ab24-9d4768c82cef/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:229 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volumes/kubernetes.io~projected/kube-api-access-nkgkm DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/46929db8-c3de-4e58-90e3-3099456b9018/volumes/kubernetes.io~projected/kube-api-access-n9s7h DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/daa200e13a67e817eda24cc1a1b5e38d2be57b472425f071d1d877d478f1af6a/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-471 DeviceMajor:0 DeviceMinor:471 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b76ad395b72caf8d46481fcb1634f79cde8cbdbad2a6f54d018eb00893e8b9ee/userdata/shm DeviceMajor:0 DeviceMinor:287 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4c43a258-8b6a-4d05-a56f-dfd659fc37d8/volumes/kubernetes.io~projected/kube-api-access-942jl DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6a6dde53-407d-43ce-84df-30c1a1e08580/volumes/kubernetes.io~projected/kube-api-access-lf7ph DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/46f076a2-ab34-4a66-a113-66fa2291345d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/171545bb-2c69-4ce1-828c-539f326f1c37/volumes/kubernetes.io~projected/kube-api-access-5qb9k DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/518907a2cf170b030c32309a61bf0a6e80c6332f46b518997569de475e56f0c2/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/71d50f85291478939e86f027340edee374c8f19ad3736184967b9287a718a479/userdata/shm DeviceMajor:0 DeviceMinor:411 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38a9e6d4a1054fb9c2afc81a411e782efe155e2da5b889dbb643faafd01deaec/userdata/shm DeviceMajor:0 DeviceMinor:445 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ae27e7a7-3d44-45dc-a232-4e85a5027a12/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d2b34c50-498f-4371-b594-d3fd404192af/volumes/kubernetes.io~projected/kube-api-access-6cgd7 DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c4d115fa2239359d01dba68929f314f1c886102a812933df68d462d4c8483ad3/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0e4712aeb6b09cf MacAddress:8a:9c:bf:13:9b:02 Speed:10000 Mtu:8901} {Name:103381988e5bf89 MacAddress:de:d3:2d:9a:0f:b0 Speed:10000 Mtu:8901} {Name:1be4735e63a0d4f MacAddress:66:8d:bb:cf:55:87 Speed:10000 Mtu:8901} {Name:1c59b2faf315c0d MacAddress:2a:ae:41:ee:77:ff Speed:10000 Mtu:8901} {Name:20fbc4a20277fc4 MacAddress:5a:ea:60:3a:6b:79 Speed:10000 Mtu:8901} {Name:21f0e9594491b52 MacAddress:3a:43:90:ad:20:81 Speed:10000 Mtu:8901} {Name:227df5841285f25 MacAddress:b2:65:36:bd:7f:a6 Speed:10000 Mtu:8901} {Name:38a9e6d4a1054fb MacAddress:ca:3d:b2:b4:bd:c0 Speed:10000 Mtu:8901} {Name:43c5e4b229009c7 MacAddress:f2:47:42:cb:8a:37 Speed:10000 Mtu:8901} {Name:518907a2cf170b0 MacAddress:6e:37:f8:9f:79:ac Speed:10000 Mtu:8901} {Name:55172ee5882240b MacAddress:4e:c1:17:dc:fe:75 Speed:10000 Mtu:8901} {Name:67424bc9b8b04a1 MacAddress:b6:04:37:67:e5:90 Speed:10000 Mtu:8901} {Name:71d50f852914789 MacAddress:92:33:2f:80:d5:e9 Speed:10000 Mtu:8901} {Name:720456d099682ee MacAddress:0e:49:23:1e:61:3f Speed:10000 Mtu:8901} {Name:7ba12a3464c1bef MacAddress:92:72:82:48:50:cd Speed:10000 Mtu:8901} {Name:81be44842c4c822 MacAddress:1e:0b:c7:a2:3a:1d Speed:10000 Mtu:8901} {Name:8b87c659ab14054 MacAddress:8a:16:b0:1b:a8:88 Speed:10000 Mtu:8901} {Name:917b5535e248c79 MacAddress:76:11:f0:bc:06:01 Speed:10000 Mtu:8901} {Name:b76ad395b72caf8 MacAddress:fa:fb:99:6b:5d:bf Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:ef:e9:9b:cf Speed:0 Mtu:9001} {Name:br-int MacAddress:f2:79:75:4e:96:43 Speed:0 Mtu:8901} {Name:c1aff98d6814547 MacAddress:fe:1c:bb:38:f5:b4 Speed:10000 Mtu:8901} {Name:ce570bb954decbe MacAddress:4e:b2:74:c7:2b:54 Speed:10000 Mtu:8901} {Name:daa200e13a67e81 MacAddress:32:6c:fc:dd:b8:3f Speed:10000 Mtu:8901} {Name:e05fc7cc610824c MacAddress:c6:38:a5:3a:ce:b2 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:06:ff:ef:e9:9b:cf Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:2e:07:a4:03:54:90 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ee:a4:aa:f2:ef:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 00:14:58.396726 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.396394    5925 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 00:14:58.396726 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.396451    5925 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 00:14:58.396831 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.396807    5925 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 00:14:58.396982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.396831    5925 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-47.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 00:14:58.397063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.396985    5925 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 00:14:58.397063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.396998    5925 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 00:14:58.397063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397016    5925 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:14:58.397203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397082    5925 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:14:58.397203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397111    5925 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 00:14:58.397357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397343    5925 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 00:14:58.397518 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397506    5925 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 00:14:58.397573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397556    5925 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 00:14:58.397573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397572    5925 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 00:14:58.397657 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397586    5925 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 00:14:58.397657 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397601    5925 kubelet.go:405] "Adding apiserver pod source"
Oct 31 00:14:58.397657 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.397613    5925 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 00:14:58.398278 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.398263    5925 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 00:14:58.398278 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.398277    5925 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:14:58.398822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.398806    5925 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 00:14:58.402674 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.402657    5925 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 00:14:58.402674 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.402672    5925 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:14:58.402796 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.402786    5925 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 00:14:58.402980 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.402969    5925 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 00:14:58.403017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.402999    5925 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 00:14:58.403095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403086    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 00:14:58.403129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403101    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 00:14:58.403129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403107    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 00:14:58.403129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403113    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 00:14:58.403129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403119    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 00:14:58.403129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403126    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 00:14:58.403129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403131    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403137    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403144    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403149    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403158    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403168    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403191    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 00:14:58.403323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.403197    5925 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 00:14:58.406549 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.406535    5925 server.go:1263] "Started kubelet"
Oct 31 00:14:58.406706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.406653    5925 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 00:14:58.406762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.406730    5925 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 00:14:58.407029 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.406865    5925 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 00:14:58.407044 ip-10-0-140-47 systemd[1]: Started Kubernetes Kubelet.
Oct 31 00:14:58.407222 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.407139    5925 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 00:14:58.408565 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.408548    5925 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 00:14:58.411150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411130    5925 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411263    5925 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.411293    5925 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-47.us-west-2.compute.internal\" not found"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411306    5925 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:08:43 +0000 UTC" deadline="2028-08-16 17:48:56.777969092 +0000 UTC"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411376    5925 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15737h33m58.366598216s"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411688    5925 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411700    5925 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 00:14:58.411807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.411709    5925 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 00:14:58.413371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413350    5925 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 00:14:58.413371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413370    5925 factory.go:55] Registering systemd factory
Oct 31 00:14:58.413693 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413379    5925 factory.go:223] Registration of the systemd container factory successfully
Oct 31 00:14:58.413748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413711    5925 factory.go:153] Registering CRI-O factory
Oct 31 00:14:58.413748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413727    5925 factory.go:223] Registration of the crio container factory successfully
Oct 31 00:14:58.413748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413746    5925 factory.go:103] Registering Raw factory
Oct 31 00:14:58.413891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.413760    5925 manager.go:1199] Started watching for new ooms in manager
Oct 31 00:14:58.414151 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.414137    5925 manager.go:319] Starting recovery of all containers
Oct 31 00:14:58.419726 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.419623    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6011a7bf-b396-4ff3-90b5-05f7e8aadeb5" volumeName="kubernetes.io/secret/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-agent-certs" seLinuxMountContext=""
Oct 31 00:14:58.419872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.419742    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de17cd3-32c6-464e-97a6-e9d07f2dbfb0" volumeName="kubernetes.io/secret/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 00:14:58.419872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.419762    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aebe9cd7-a93e-4707-b53c-fdaeddc05258" volumeName="kubernetes.io/configmap/aebe9cd7-a93e-4707-b53c-fdaeddc05258-telemetry-config" seLinuxMountContext=""
Oct 31 00:14:58.419872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.419807    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2b34c50-498f-4371-b594-d3fd404192af" volumeName="kubernetes.io/projected/d2b34c50-498f-4371-b594-d3fd404192af-kube-api-access-6cgd7" seLinuxMountContext=""
Oct 31 00:14:58.420114 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420091    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f53d8e59-7949-41f4-a271-1f6bf7288552" volumeName="kubernetes.io/empty-dir/f53d8e59-7949-41f4-a271-1f6bf7288552-tmp-dir" seLinuxMountContext=""
Oct 31 00:14:58.420203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420119    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="866b4904-8c80-44cf-9912-5de2ccd545b8" volumeName="kubernetes.io/configmap/866b4904-8c80-44cf-9912-5de2ccd545b8-nginx-conf" seLinuxMountContext=""
Oct 31 00:14:58.420203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420135    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55ad7d0d-4b43-4377-ab24-9d4768c82cef" volumeName="kubernetes.io/projected/55ad7d0d-4b43-4377-ab24-9d4768c82cef-kube-api-access-4j7ml" seLinuxMountContext=""
Oct 31 00:14:58.420203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420149    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55ad7d0d-4b43-4377-ab24-9d4768c82cef" volumeName="kubernetes.io/secret/55ad7d0d-4b43-4377-ab24-9d4768c82cef-cert" seLinuxMountContext=""
Oct 31 00:14:58.420203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420167    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="171545bb-2c69-4ce1-828c-539f326f1c37" volumeName="kubernetes.io/configmap/171545bb-2c69-4ce1-828c-539f326f1c37-config" seLinuxMountContext=""
Oct 31 00:14:58.420203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420192    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="171545bb-2c69-4ce1-828c-539f326f1c37" volumeName="kubernetes.io/secret/171545bb-2c69-4ce1-828c-539f326f1c37-serving-cert" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420206    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3734cc90-7907-4498-9a6b-7bae4757ff0b" volumeName="kubernetes.io/projected/3734cc90-7907-4498-9a6b-7bae4757ff0b-kube-api-access-v8m4c" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420219    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="462389b8-254c-4f99-ac14-5b66525f62dd" volumeName="kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-binary-copy" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420232    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46929db8-c3de-4e58-90e3-3099456b9018" volumeName="kubernetes.io/projected/46929db8-c3de-4e58-90e3-3099456b9018-kube-api-access-n9s7h" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420246    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d998f53-1c5a-4144-880c-4c69c558ab97" volumeName="kubernetes.io/projected/7d998f53-1c5a-4144-880c-4c69c558ab97-kube-api-access-5ht4s" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420263    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" volumeName="kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420276    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aebe9cd7-a93e-4707-b53c-fdaeddc05258" volumeName="kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420288    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c43a258-8b6a-4d05-a56f-dfd659fc37d8" volumeName="kubernetes.io/projected/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-kube-api-access-942jl" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420303    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c43a258-8b6a-4d05-a56f-dfd659fc37d8" volumeName="kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420316    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a6dde53-407d-43ce-84df-30c1a1e08580" volumeName="kubernetes.io/projected/6a6dde53-407d-43ce-84df-30c1a1e08580-kube-api-access-lf7ph" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420331    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bbd3db6-4290-4d6c-9735-519c8585376b" volumeName="kubernetes.io/projected/6bbd3db6-4290-4d6c-9735-519c8585376b-kube-api-access-mw5d5" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420345    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420357    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b899807e-b82b-4d93-b1b7-ce371ff91281" volumeName="kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420371    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb" volumeName="kubernetes.io/projected/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-kube-api-access-k9z2m" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420389    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6e98896-64cd-4abd-94ef-a95f65f5d05d" volumeName="kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420404    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46f076a2-ab34-4a66-a113-66fa2291345d" volumeName="kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-snapshots" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420444    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de17cd3-32c6-464e-97a6-e9d07f2dbfb0" volumeName="kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420460    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de17cd3-32c6-464e-97a6-e9d07f2dbfb0" volumeName="kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-config" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420477    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de17cd3-32c6-464e-97a6-e9d07f2dbfb0" volumeName="kubernetes.io/projected/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-kube-api-access-nkgkm" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420501    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6362fc09-4b02-49dd-8e75-db40d935cc71" volumeName="kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420514    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420528    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77330f26-0bd9-4176-86b7-780fed040b10" volumeName="kubernetes.io/projected/77330f26-0bd9-4176-86b7-780fed040b10-kube-api-access-mdpmc" seLinuxMountContext=""
Oct 31 00:14:58.420533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420543    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b899807e-b82b-4d93-b1b7-ce371ff91281" volumeName="kubernetes.io/projected/b899807e-b82b-4d93-b1b7-ce371ff91281-kube-api-access-l4zv5" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420557    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e0762913-8550-41b9-a1a8-d2df14f88004" volumeName="kubernetes.io/projected/e0762913-8550-41b9-a1a8-d2df14f88004-kube-api-access-qrlst" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420571    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="462389b8-254c-4f99-ac14-5b66525f62dd" volumeName="kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420585    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="49c09e8f-95c6-423d-8067-258613cbbe22" volumeName="kubernetes.io/projected/49c09e8f-95c6-423d-8067-258613cbbe22-kube-api-access-w7ph4" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420598    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de17cd3-32c6-464e-97a6-e9d07f2dbfb0" volumeName="kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-env-overrides" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420629    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aebe9cd7-a93e-4707-b53c-fdaeddc05258" volumeName="kubernetes.io/projected/aebe9cd7-a93e-4707-b53c-fdaeddc05258-kube-api-access-jxbln" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420643    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d4205e63-79f8-4bda-861a-5402609c037f" volumeName="kubernetes.io/projected/d4205e63-79f8-4bda-861a-5402609c037f-kube-api-access-swqp8" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420656    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07c85ed3-44fd-4fb8-824f-468184be0d4d" volumeName="kubernetes.io/projected/07c85ed3-44fd-4fb8-824f-468184be0d4d-kube-api-access-2dq55" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420668    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40109db6-b298-4a83-af09-889703196f40" volumeName="kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420681    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420702    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77330f26-0bd9-4176-86b7-780fed040b10" volumeName="kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420716    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b899807e-b82b-4d93-b1b7-ce371ff91281" volumeName="kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-default-certificate" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420731    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3734cc90-7907-4498-9a6b-7bae4757ff0b" volumeName="kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-config" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420743    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46f076a2-ab34-4a66-a113-66fa2291345d" volumeName="kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420757    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420769    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d998f53-1c5a-4144-880c-4c69c558ab97" volumeName="kubernetes.io/configmap/7d998f53-1c5a-4144-880c-4c69c558ab97-serviceca" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420782    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="866b4904-8c80-44cf-9912-5de2ccd545b8" volumeName="kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420794    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae27e7a7-3d44-45dc-a232-4e85a5027a12" volumeName="kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-tuned" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420807    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2b34c50-498f-4371-b594-d3fd404192af" volumeName="kubernetes.io/configmap/d2b34c50-498f-4371-b594-d3fd404192af-config" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420820    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d3e66be-14ba-4baa-b6fd-bf32374ab3c2" volumeName="kubernetes.io/projected/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2-kube-api-access-zpr5s" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420835    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3734cc90-7907-4498-9a6b-7bae4757ff0b" volumeName="kubernetes.io/secret/3734cc90-7907-4498-9a6b-7bae4757ff0b-serving-cert" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420848    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40109db6-b298-4a83-af09-889703196f40" volumeName="kubernetes.io/projected/40109db6-b298-4a83-af09-889703196f40-kube-api-access-zl5nz" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420860    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420874    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420888    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420911    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="77330f26-0bd9-4176-86b7-780fed040b10" volumeName="kubernetes.io/configmap/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-config" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420924    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b899807e-b82b-4d93-b1b7-ce371ff91281" volumeName="kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420936    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46f076a2-ab34-4a66-a113-66fa2291345d" volumeName="kubernetes.io/projected/46f076a2-ab34-4a66-a113-66fa2291345d-kube-api-access-97f5b" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420949    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" volumeName="kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420961    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b899807e-b82b-4d93-b1b7-ce371ff91281" volumeName="kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-stats-auth" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420977    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb" volumeName="kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cni-binary-copy" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.420991    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d2b34c50-498f-4371-b594-d3fd404192af" volumeName="kubernetes.io/secret/d2b34c50-498f-4371-b594-d3fd404192af-serving-cert" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421004    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f53d8e59-7949-41f4-a271-1f6bf7288552" volumeName="kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421016    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3734cc90-7907-4498-9a6b-7bae4757ff0b" volumeName="kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-trusted-ca" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421030    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46f076a2-ab34-4a66-a113-66fa2291345d" volumeName="kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-service-ca-bundle" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421043    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6011a7bf-b396-4ff3-90b5-05f7e8aadeb5" volumeName="kubernetes.io/configmap/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-konnectivity-ca" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421056    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae27e7a7-3d44-45dc-a232-4e85a5027a12" volumeName="kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-tmp" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421069    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d4205e63-79f8-4bda-861a-5402609c037f" volumeName="kubernetes.io/configmap/d4205e63-79f8-4bda-861a-5402609c037f-iptables-alerter-script" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421082    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0347cd21-2175-4a7c-8a9c-239cf3b5a392" volumeName="kubernetes.io/projected/0347cd21-2175-4a7c-8a9c-239cf3b5a392-kube-api-access-49spz" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421095    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="171545bb-2c69-4ce1-828c-539f326f1c37" volumeName="kubernetes.io/projected/171545bb-2c69-4ce1-828c-539f326f1c37-kube-api-access-5qb9k" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421108    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40109db6-b298-4a83-af09-889703196f40" volumeName="kubernetes.io/empty-dir/40109db6-b298-4a83-af09-889703196f40-data-volume" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421121    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f53d8e59-7949-41f4-a271-1f6bf7288552" volumeName="kubernetes.io/configmap/f53d8e59-7949-41f4-a271-1f6bf7288552-config-volume" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421137    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f53d8e59-7949-41f4-a271-1f6bf7288552" volumeName="kubernetes.io/projected/f53d8e59-7949-41f4-a271-1f6bf7288552-kube-api-access-jq9s6" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421151    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40109db6-b298-4a83-af09-889703196f40" volumeName="kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421164    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="462389b8-254c-4f99-ac14-5b66525f62dd" volumeName="kubernetes.io/projected/462389b8-254c-4f99-ac14-5b66525f62dd-kube-api-access-qr2f5" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421178    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46f076a2-ab34-4a66-a113-66fa2291345d" volumeName="kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-tmp" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421191    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="46f076a2-ab34-4a66-a113-66fa2291345d" volumeName="kubernetes.io/secret/46f076a2-ab34-4a66-a113-66fa2291345d-serving-cert" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421204    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a6dde53-407d-43ce-84df-30c1a1e08580" volumeName="kubernetes.io/empty-dir/6a6dde53-407d-43ce-84df-30c1a1e08580-tmp-dir" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421217    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae27e7a7-3d44-45dc-a232-4e85a5027a12" volumeName="kubernetes.io/projected/ae27e7a7-3d44-45dc-a232-4e85a5027a12-kube-api-access-mkc48" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421230    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" volumeName="kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421243    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" volumeName="kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421256    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9cd937ab-d46d-4bff-8049-485b18bfdb6c" volumeName="kubernetes.io/projected/9cd937ab-d46d-4bff-8049-485b18bfdb6c-kube-api-access-m8lrp" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421268    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb" volumeName="kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-daemon-config" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421282    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="462389b8-254c-4f99-ac14-5b66525f62dd" volumeName="kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421296    5925 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7729e485-91fd-498c-8927-db2c765a9357" volumeName="kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token" seLinuxMountContext=""
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421310    5925 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 00:14:58.421586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.421320    5925 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 00:14:58.440825 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.440797    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:14:58.442698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.442642    5925 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 00:14:58.443202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.443179    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:14:58.444349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.444243    5925 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 00:14:58.444349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.444291    5925 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 00:14:58.444349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.444316    5925 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 00:14:58.445836 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.445746    5925 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 00:14:58.460303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.460276    5925 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="2fd89382d4eaba9edb0e351e2fc2655584f15c7e44a39e9b8d43ff157ab9b49d" exitCode=0
Oct 31 00:14:58.460303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.460301    5925 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="f7af4025b5385d85c91b6b8882eb6a7f735aca493618294e67e0e712325a6e43" exitCode=0
Oct 31 00:14:58.460475 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.460307    5925 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="95305ce2ce6cfbbbf2189a6fce70f541ce2ce26fd0d5d56f7d05e9b1de7496eb" exitCode=0
Oct 31 00:14:58.460475 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.460313    5925 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="566ddf828cc1951aa0fb32ce1cf3a9717ed06cb959b00ab7dec66038bac9aa57" exitCode=0
Oct 31 00:14:58.460475 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.460318    5925 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="f12dd47ea84482840dbc7704fb5d1a4e94613a0b8501b965e3827d7352120f50" exitCode=0
Oct 31 00:14:58.460475 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.460323    5925 generic.go:356] "Generic (PLEG): container finished" podID="462389b8-254c-4f99-ac14-5b66525f62dd" containerID="12a6fe5dd59a9fde5fc682bff1264aeb57ba81ff42e2a47d47e4926b4d867811" exitCode=0
Oct 31 00:14:58.470631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.470608    5925 generic.go:356] "Generic (PLEG): container finished" podID="82dd2d032a1f8f743ca56dd4521d74cc" containerID="20b1d143c19ecd89fac49c45f55584867f52e2f676c5a13ee59ab2562e49a859" exitCode=0
Oct 31 00:14:58.511369 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.511303    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:14:58.511369 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.511329    5925 generic.go:356] "Generic (PLEG): container finished" podID="3734cc90-7907-4498-9a6b-7bae4757ff0b" containerID="e32c1e9962b8bdb8999894dc8ef08c56b51990162f0f6407b6ee968ae7f74493" exitCode=255
Oct 31 00:14:58.511369 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.511347    5925 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-140-47.us-west-2.compute.internal\" not found"
Oct 31 00:14:58.537924 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.537903    5925 manager.go:324] Recovery completed
Oct 31 00:14:58.545842 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.545822    5925 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 31 00:14:58.558223 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.558207    5925 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:14:58.560219 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.560202    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:14:58.560317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.560235    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:14:58.560317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.560252    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:14:58.563768 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.563747    5925 cpu_manager.go:226] "Starting" policy="none"
Oct 31 00:14:58.563768 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.563768    5925 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 00:14:58.563910 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.563788    5925 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 00:14:58.564000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.563981    5925 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 00:14:58.564071 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564004    5925 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 00:14:58.564071 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564030    5925 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 00:14:58.564071 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564040    5925 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 00:14:58.564071 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564048    5925 policy_none.go:50] "Start"
Oct 31 00:14:58.564071 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564070    5925 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 00:14:58.564298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564085    5925 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 00:14:58.564350 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564328    5925 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 00:14:58.564350 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564340    5925 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 00:14:58.564350 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.564349    5925 policy_none.go:44] "Start"
Oct 31 00:14:58.565283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.565263    5925 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:14:58.566449 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.566429    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:14:58.566539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.566463    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:14:58.566539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.566473    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:14:58.569902 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.569871    5925 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 00:14:58.572568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.572553    5925 manager.go:341] "Starting Device Plugin manager"
Oct 31 00:14:58.572646 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.572583    5925 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 00:14:58.572646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.572595    5925 server.go:87] "Starting device plugin registration server"
Oct 31 00:14:58.572887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.572874    5925 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 00:14:58.572948 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.572889    5925 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 00:14:58.573015 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.572993    5925 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 00:14:58.573141 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.573099    5925 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 00:14:58.573191 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.573143    5925 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 00:14:58.573191 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.573150    5925 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 00:14:58.573273 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.573188    5925 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:14:58.573133098Z","UUID":"427040e2-232c-4ca5-9804-3990a37b5984","Handler":null,"Name":"","Endpoint":""}
Oct 31 00:14:58.574970 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.574950    5925 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 00:14:58.575061 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.574984    5925 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-47.us-west-2.compute.internal\" not found"
Oct 31 00:14:58.575113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.575091    5925 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 00:14:58.575150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.575119    5925 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 00:14:58.601984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.601964    5925 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:14:58.601984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.601979    5925 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 00:14:58.602593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.602578    5925 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:14:58.602673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.602634    5925 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:14:58.650720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.650695    5925 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:14:58.673703 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.673672    5925 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:14:58.674938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.674920    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:14:58.675016 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.674955    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:14:58.675016 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.674966    5925 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-140-47.us-west-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:14:58.675016 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.675012    5925 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.746896 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.746822    5925 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"]
Oct 31 00:14:58.747546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747507    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"82dd2d032a1f8f743ca56dd4521d74cc","Type":"ContainerStarted","Data":"93b722e8dc1e3ff75aeecb3d513f4d05525e0da6c1580b3571d060daef938c30"}
Oct 31 00:14:58.747602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747560    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"82dd2d032a1f8f743ca56dd4521d74cc","Type":"ContainerDied","Data":"20b1d143c19ecd89fac49c45f55584867f52e2f676c5a13ee59ab2562e49a859"}
Oct 31 00:14:58.747602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747575    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"82dd2d032a1f8f743ca56dd4521d74cc","Type":"ContainerStarted","Data":"9249d24404134375caf7e37e56175cfa614a4154686289580add694f18933013"}
Oct 31 00:14:58.747681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747626    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"fd984434bab802ab7f7b4fe5c1c36bf9","Type":"ContainerStarted","Data":"3ab6189efdcb0651e4894fad910a285d3f36827553494bfa939c34434e7a8ea4"}
Oct 31 00:14:58.747681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747645    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal" event={"ID":"fd984434bab802ab7f7b4fe5c1c36bf9","Type":"ContainerStarted","Data":"3d696e7c7989af9464e73adfe755e270b775ea5fb16856c2326ca856f05039a3"}
Oct 31 00:14:58.747758 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747629    5925 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.747758 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.747749    5925 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.779392 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.779316    5925 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.779566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.779394    5925 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.806135 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.806106    5925 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:14:58.806247 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.806155    5925 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.806912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.806896    5925 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:14:58.806999 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:58.806931    5925 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.903540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.903504    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.903680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.903543    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:58.903680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:58.903562    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd984434bab802ab7f7b4fe5c1c36bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"fd984434bab802ab7f7b4fe5c1c36bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.004710 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.004631    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.004851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.004739    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd984434bab802ab7f7b4fe5c1c36bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"fd984434bab802ab7f7b4fe5c1c36bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.004851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.004765    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.004851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.004672    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.004851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.004802    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd984434bab802ab7f7b4fe5c1c36bf9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"fd984434bab802ab7f7b4fe5c1c36bf9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.004851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.004837    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/82dd2d032a1f8f743ca56dd4521d74cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" (UID: \"82dd2d032a1f8f743ca56dd4521d74cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.397880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.397844    5925 apiserver.go:52] "Watching apiserver"
Oct 31 00:14:59.526398 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.526370    5925 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.526560 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.526476    5925 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.544394 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.544377    5925 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 00:14:59.545052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.545028    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27","openshift-image-registry/image-registry-567894c8cd-bksgp","kube-system/kas-connection-checker-685895c7c9-k6mcf","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m","openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z","kube-system/kas-connection-checker-685895c7c9-sxf6j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb","openshift-dns/dns-default-q5zwx","openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx","kube-system/global-pull-secret-syncer-65fz2","openshift-network-diagnostics/network-check-target-jxpcb","kube-system/konnectivity-agent-slhsd","openshift-network-operator/iptables-alerter-xtq8q","openshift-insights/insights-operator-7c4986d449-rt22m","openshift-insights/insights-runtime-extractor-ww2hz","openshift-multus/network-metrics-daemon-5725k","openshift-multus/multus-zf867","openshift-ingress-canary/ingress-canary-gzr86","openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf","kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal","openshift-ovn-kubernetes/ovnkube-node-cq2q6","kube-system/kas-connection-checker-685895c7c9-7j8dt","openshift-ingress/router-default-7c7d9879df-g4m8t","openshift-network-console/networking-console-plugin-86c478bb88-5xjzr","openshift-console-operator/console-operator-7cd56b8dbc-crbc6","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs","openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75","openshift-cluster-node-tuning-operator/tuned-89qld","openshift-dns/node-resolver-6cjm6","openshift-insights/periodic-gathering-mjrm9-mxnnz","openshift-image-registry/node-ca-vxfn8","openshift-multus/multus-additional-cni-plugins-nnpg6"]
Oct 31 00:14:59.585162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.585136    5925 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:14:59.585284 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:59.585183    5925 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.585611 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.585599    5925 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:14:59.585647 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:14:59.585627    5925 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-47.us-west-2.compute.internal"
Oct 31 00:14:59.597639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597616    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.597755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597715    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.597755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597725    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 00:14:59.597755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597715    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597760    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597766    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597773    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597784    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597805    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597819    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597829    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597836    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597845    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.597931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.597843    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.598320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598066    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.598320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598081    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.598320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598162    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.598582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598566    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.598624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598614    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.598755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598737    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 00:14:59.598863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598847    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.598922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598869    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 00:14:59.598922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.598902    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.599027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.599013    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.599138 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.599122    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 00:14:59.599259 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.599244    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.599306 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.599249    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 00:14:59.613913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.613896    5925 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 00:14:59.646113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646089    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 00:14:59.646113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646107    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 00:14:59.646275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646132    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q42zw\""
Oct 31 00:14:59.646275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646172    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 00:14:59.646275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646250    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-clchl\""
Oct 31 00:14:59.646275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646264    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 00:14:59.646463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646333    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 00:14:59.646463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646365    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 00:14:59.646463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646391    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xkrjn\""
Oct 31 00:14:59.646463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646401    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 00:14:59.646463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646460    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gdwzq\""
Oct 31 00:14:59.646662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646529    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xwrcd\""
Oct 31 00:14:59.646662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646631    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 00:14:59.646662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646635    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lx8pb\""
Oct 31 00:14:59.646800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646676    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 00:14:59.646800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646698    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 00:14:59.646800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646738    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 00:14:59.646800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646759    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z2qz5\""
Oct 31 00:14:59.646800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646777    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646817    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646826    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646831    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646841    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646850    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646874    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646878    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646883    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646919    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646935    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646938    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 00:14:59.647017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.646975    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647094    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647100    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647105    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647139    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647161    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647172    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647193    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647200    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647197    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647215    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647215    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647220    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647247    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647306    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647468    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647509    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647524    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 00:14:59.647561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.647551    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 00:14:59.648277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.648238    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 00:14:59.700097 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700076    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 00:14:59.700266 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700252    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v2pb4\""
Oct 31 00:14:59.700409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700393    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 00:14:59.700494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700429    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-lg2hb\""
Oct 31 00:14:59.700494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700436    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 00:14:59.700580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700543    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hcz6l\""
Oct 31 00:14:59.700677 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700660    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-5jgbw\""
Oct 31 00:14:59.700751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700667    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h9nxs\""
Oct 31 00:14:59.700751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700680    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ds5xr\""
Oct 31 00:14:59.700751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700705    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xfr46\""
Oct 31 00:14:59.700751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700737    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 00:14:59.700932 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.700832    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 00:14:59.701098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701077    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-plmbm\""
Oct 31 00:14:59.701214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701155    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74dxc\""
Oct 31 00:14:59.701214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701167    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j5mcv\""
Oct 31 00:14:59.701214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701189    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-qszwm\""
Oct 31 00:14:59.701214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701191    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pk6r6\""
Oct 31 00:14:59.701214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701200    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-bcxbn\""
Oct 31 00:14:59.701214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701188    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bvv2r\""
Oct 31 00:14:59.701551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701236    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 00:14:59.701551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701269    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 00:14:59.701551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701290    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jpbc7\""
Oct 31 00:14:59.701551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701366    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qdpqj\""
Oct 31 00:14:59.701551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701400    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 00:14:59.701551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701478    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-gndw5\""
Oct 31 00:14:59.701888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701578    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7hvcc\""
Oct 31 00:14:59.701888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701676    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 00:14:59.701888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701701    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zk5sj\""
Oct 31 00:14:59.701888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701739    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 00:14:59.701888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701739    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:14:59.701888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.701823    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:14:59.708890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.708872    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-netns\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.708940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.708899    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-k8s-cni-cncf-io\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.708940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.708914    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40109db6-b298-4a83-af09-889703196f40-crio-socket\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.709041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.708938    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl5nz\" (UniqueName: \"kubernetes.io/projected/40109db6-b298-4a83-af09-889703196f40-kube-api-access-zl5nz\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.709041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.708960    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-kubelet-config\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.709107 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709052    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-agent-certs\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:14:59.709107 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709086    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55ad7d0d-4b43-4377-ab24-9d4768c82cef-cert\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:59.709177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709121    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ph4\" (UniqueName: \"kubernetes.io/projected/49c09e8f-95c6-423d-8067-258613cbbe22-kube-api-access-w7ph4\") pod \"migrator-66df5d496b-fx7bx\" (UID: \"49c09e8f-95c6-423d-8067-258613cbbe22\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:59.709177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709155    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.709270 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709183    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53d8e59-7949-41f4-a271-1f6bf7288552-config-volume\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.709270 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709211    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-socket-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.709270 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709245    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171545bb-2c69-4ce1-828c-539f326f1c37-serving-cert\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:59.709430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709273    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.709430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709304    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-cnibin\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.709430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709343    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.709430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709374    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:59.709430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709406    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-host\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.709686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709451    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-dbus\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.709686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709483    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-konnectivity-ca\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:14:59.709776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709693    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f53d8e59-7949-41f4-a271-1f6bf7288552-config-volume\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.709776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709717    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.709776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709731    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-agent-certs\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:14:59.709931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709851    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.709931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709883    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55ad7d0d-4b43-4377-ab24-9d4768c82cef-cert\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:59.709931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709905    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-systemd\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.710062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709964    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/866b4904-8c80-44cf-9912-5de2ccd545b8-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:59.710062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709989    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6011a7bf-b396-4ff3-90b5-05f7e8aadeb5-konnectivity-ca\") pod \"konnectivity-agent-slhsd\" (UID: \"6011a7bf-b396-4ff3-90b5-05f7e8aadeb5\") " pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:14:59.710062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.709994    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-config\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.710173 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710136    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-etc-kubernetes\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.710173 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710158    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-system-cni-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.710259 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710214    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-config\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.710534 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710519    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/171545bb-2c69-4ce1-828c-539f326f1c37-serving-cert\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:59.710606 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710175    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-sys\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.710639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710622    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.710676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710641    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.710676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710656    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-hostroot\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.710676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710671    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9z2m\" (UniqueName: \"kubernetes.io/projected/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-kube-api-access-k9z2m\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.710807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710685    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866b4904-8c80-44cf-9912-5de2ccd545b8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:59.710807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710702    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-bin\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.710987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.710905    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.711144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711110    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b34c50-498f-4371-b594-d3fd404192af-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:59.711242 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711216    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f53d8e59-7949-41f4-a271-1f6bf7288552-metrics-tls\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.711319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711273    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-socket-dir-parent\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.711407 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711383    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.711491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711454    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/866b4904-8c80-44cf-9912-5de2ccd545b8-nginx-conf\") pod \"networking-console-plugin-86c478bb88-5xjzr\" (UID: \"866b4904-8c80-44cf-9912-5de2ccd545b8\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-5xjzr"
Oct 31 00:14:59.711548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711506    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2b34c50-498f-4371-b594-d3fd404192af-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:59.711629 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711591    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-conf-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.711683 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711660    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqp8\" (UniqueName: \"kubernetes.io/projected/d4205e63-79f8-4bda-861a-5402609c037f-kube-api-access-swqp8\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.711732 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711697    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdpmc\" (UniqueName: \"kubernetes.io/projected/77330f26-0bd9-4176-86b7-780fed040b10-kube-api-access-mdpmc\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:59.711789 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711749    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpr5s\" (UniqueName: \"kubernetes.io/projected/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2-kube-api-access-zpr5s\") pod \"migrator-66df5d496b-bdcmf\" (UID: \"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:59.711789 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711778    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.711888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711810    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-env-overrides\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.711888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711844    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.712400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.711877    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.712400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712263    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-conf\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.712610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712436    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-default-certificate\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.712610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712486    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.712610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712525    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.712610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712581    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-netns\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.712894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712616    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-run\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.712894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712639    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.712894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712704    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aebe9cd7-a93e-4707-b53c-fdaeddc05258-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:59.712894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712763    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.712894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712800    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.713243 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.712855    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b34c50-498f-4371-b594-d3fd404192af-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:59.713328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713220    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49spz\" (UniqueName: \"kubernetes.io/projected/0347cd21-2175-4a7c-8a9c-239cf3b5a392-kube-api-access-49spz\") pod \"network-check-source-6f78d59f99-9lx75\" (UID: \"0347cd21-2175-4a7c-8a9c-239cf3b5a392\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:59.713328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713304    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b34c50-498f-4371-b594-d3fd404192af-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:59.713328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713307    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.713533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713385    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovn-node-metrics-cert\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.713533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713459    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:59.713533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713498    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5d5\" (UniqueName: \"kubernetes.io/projected/6bbd3db6-4290-4d6c-9735-519c8585376b-kube-api-access-mw5d5\") pod \"kas-connection-checker-685895c7c9-sxf6j\" (UID: \"6bbd3db6-4290-4d6c-9735-519c8585376b\") " pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:59.713533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713529    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-kubernetes\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.713782 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713563    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-stats-auth\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.713782 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713581    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.713922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713742    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7ph\" (UniqueName: \"kubernetes.io/projected/6a6dde53-407d-43ce-84df-30c1a1e08580-kube-api-access-lf7ph\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.713922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713850    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-systemd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.713922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713878    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-var-lib-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.714101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713911    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-kubelet\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.714101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.713982    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr2f5\" (UniqueName: \"kubernetes.io/projected/462389b8-254c-4f99-ac14-5b66525f62dd-kube-api-access-qr2f5\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.714101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714048    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrlst\" (UniqueName: \"kubernetes.io/projected/e0762913-8550-41b9-a1a8-d2df14f88004-kube-api-access-qrlst\") pod \"kas-connection-checker-685895c7c9-7j8dt\" (UID: \"e0762913-8550-41b9-a1a8-d2df14f88004\") " pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:59.714303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714127    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.714303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714171    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.714303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714203    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.714519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714271    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-daemon-config\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.714519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714337    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-service-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.714519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714381    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f076a2-ab34-4a66-a113-66fa2291345d-serving-cert\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.714519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714467    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.714519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714474    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d998f53-1c5a-4144-880c-4c69c558ab97-host\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714544    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714575    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4205e63-79f8-4bda-861a-5402609c037f-host-slash\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714606    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-tmp\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714670    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ht4s\" (UniqueName: \"kubernetes.io/projected/7d998f53-1c5a-4144-880c-4c69c558ab97-kube-api-access-5ht4s\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714729    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714760    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dq55\" (UniqueName: \"kubernetes.io/projected/07c85ed3-44fd-4fb8-824f-468184be0d4d-kube-api-access-2dq55\") pod \"volume-data-source-validator-58c9f5f46d-h88qb\" (UID: \"07c85ed3-44fd-4fb8-824f-468184be0d4d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:59.714842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714791    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-kubelet\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714862    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-multus-certs\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714927    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8lrp\" (UniqueName: \"kubernetes.io/projected/9cd937ab-d46d-4bff-8049-485b18bfdb6c-kube-api-access-m8lrp\") pod \"kas-connection-checker-685895c7c9-k6mcf\" (UID: \"9cd937ab-d46d-4bff-8049-485b18bfdb6c\") " pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.714966    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715025    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715057    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715094    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-script-lib\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715127    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-sys-fs\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715160    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s7h\" (UniqueName: \"kubernetes.io/projected/46929db8-c3de-4e58-90e3-3099456b9018-kube-api-access-n9s7h\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715189    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-registration-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715195    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovn-node-metrics-cert\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715217    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715258    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-snapshots\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.715317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715302    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkc48\" (UniqueName: \"kubernetes.io/projected/ae27e7a7-3d44-45dc-a232-4e85a5027a12-kube-api-access-mkc48\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715447    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-942jl\" (UniqueName: \"kubernetes.io/projected/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-kube-api-access-942jl\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715451    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715495    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715562    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171545bb-2c69-4ce1-828c-539f326f1c37-config\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715601    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-var-lib-kubelet\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715647    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8m4c\" (UniqueName: \"kubernetes.io/projected/3734cc90-7907-4498-9a6b-7bae4757ff0b-kube-api-access-v8m4c\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715678    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-system-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715722    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715779    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715819    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-etc-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715850    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-netd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715906    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715937    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-bin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.715993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.715962    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.716645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716032    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-lib-modules\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.716645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716227    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-tmp\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.716645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716294    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-systemd-units\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.716645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716378    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-stats-auth\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.716645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716396    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-default-certificate\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.716645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716446    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/aebe9cd7-a93e-4707-b53c-fdaeddc05258-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:59.716918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716721    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-env-overrides\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.716969 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.716911    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/171545bb-2c69-4ce1-828c-539f326f1c37-config\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:59.717154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717116    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-ovnkube-script-lib\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.717502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717481    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46f076a2-ab34-4a66-a113-66fa2291345d-service-ca-bundle\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.717588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717527    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.717639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717612    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-slash\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.717688 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717666    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-tmp\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.717740 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717710    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j7ml\" (UniqueName: \"kubernetes.io/projected/55ad7d0d-4b43-4377-ab24-9d4768c82cef-kube-api-access-4j7ml\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:59.717796 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717743    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-log-socket\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.717868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717849    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-metrics-certs\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:59.717927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.717843    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.718034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718013    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-daemon-config\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.718098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718033    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.718098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718011    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/462389b8-254c-4f99-ac14-5b66525f62dd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.718098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718063    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/46f076a2-ab34-4a66-a113-66fa2291345d-serving-cert\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.718098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718036    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6362fc09-4b02-49dd-8e75-db40d935cc71-original-pull-secret\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.718235 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718101    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-snapshots\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718403    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgkm\" (UniqueName: \"kubernetes.io/projected/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-kube-api-access-nkgkm\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718102    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718455    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f076a2-ab34-4a66-a113-66fa2291345d-tmp\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718548    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40109db6-b298-4a83-af09-889703196f40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718562    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40109db6-b298-4a83-af09-889703196f40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718668    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718726    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-tuned\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.718787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718779    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3734cc90-7907-4498-9a6b-7bae4757ff0b-serving-cert\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718817    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-tuned\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718821    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/aebe9cd7-a93e-4707-b53c-fdaeddc05258-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718856    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-node-log\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718912    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b899807e-b82b-4d93-b1b7-ce371ff91281-service-ca-bundle\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.718962    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53d8e59-7949-41f4-a271-1f6bf7288552-tmp-dir\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719025    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f53d8e59-7949-41f4-a271-1f6bf7288552-tmp-dir\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719053    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cnibin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719064    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3734cc90-7907-4498-9a6b-7bae4757ff0b-serving-cert\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719100    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4205e63-79f8-4bda-861a-5402609c037f-iptables-alerter-script\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.719148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719147    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qb9k\" (UniqueName: \"kubernetes.io/projected/171545bb-2c69-4ce1-828c-539f326f1c37-kube-api-access-5qb9k\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719205    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719266    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-trusted-ca\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719301    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d4205e63-79f8-4bda-861a-5402609c037f-iptables-alerter-script\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719356    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719463    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a6dde53-407d-43ce-84df-30c1a1e08580-tmp-dir\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719493    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719538    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgd7\" (UniqueName: \"kubernetes.io/projected/d2b34c50-498f-4371-b594-d3fd404192af-kube-api-access-6cgd7\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:59.719601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719592    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a6dde53-407d-43ce-84df-30c1a1e08580-tmp-dir\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719675    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-trusted-ca\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719723    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97f5b\" (UniqueName: \"kubernetes.io/projected/46f076a2-ab34-4a66-a113-66fa2291345d-kube-api-access-97f5b\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719827    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbln\" (UniqueName: \"kubernetes.io/projected/aebe9cd7-a93e-4707-b53c-fdaeddc05258-kube-api-access-jxbln\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719860    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-config\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719894    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-ovn\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719917    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719930    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysconfig\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.720008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.719953    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720027    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3734cc90-7907-4498-9a6b-7bae4757ff0b-config\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720064    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9s6\" (UniqueName: \"kubernetes.io/projected/f53d8e59-7949-41f4-a271-1f6bf7288552-kube-api-access-jq9s6\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720101    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-device-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720141    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77330f26-0bd9-4176-86b7-780fed040b10-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720208    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720234    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a6dde53-407d-43ce-84df-30c1a1e08580-hosts-file\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.720276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720253    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cni-binary-copy\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720281    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-modprobe-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720310    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-multus\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720334    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720377    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cni-binary-copy\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720446    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4zv5\" (UniqueName: \"kubernetes.io/projected/b899807e-b82b-4d93-b1b7-ce371ff91281-kube-api-access-l4zv5\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720476    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40109db6-b298-4a83-af09-889703196f40-data-volume\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720491    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d998f53-1c5a-4144-880c-4c69c558ab97-serviceca\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.720593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720561    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40109db6-b298-4a83-af09-889703196f40-data-volume\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.720888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720626    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b899807e-b82b-4d93-b1b7-ce371ff91281-metrics-certs\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.720983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.720967    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7d998f53-1c5a-4144-880c-4c69c558ab97-serviceca\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.768199 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.768177    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ph4\" (UniqueName: \"kubernetes.io/projected/49c09e8f-95c6-423d-8067-258613cbbe22-kube-api-access-w7ph4\") pod \"migrator-66df5d496b-fx7bx\" (UID: \"49c09e8f-95c6-423d-8067-258613cbbe22\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-fx7bx"
Oct 31 00:14:59.770130 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.770105    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl5nz\" (UniqueName: \"kubernetes.io/projected/40109db6-b298-4a83-af09-889703196f40-kube-api-access-zl5nz\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.770732 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.770715    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9z2m\" (UniqueName: \"kubernetes.io/projected/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-kube-api-access-k9z2m\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.771868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.771850    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpr5s\" (UniqueName: \"kubernetes.io/projected/2d3e66be-14ba-4baa-b6fd-bf32374ab3c2-kube-api-access-zpr5s\") pod \"migrator-66df5d496b-bdcmf\" (UID: \"2d3e66be-14ba-4baa-b6fd-bf32374ab3c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-bdcmf"
Oct 31 00:14:59.771868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.771853    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqp8\" (UniqueName: \"kubernetes.io/projected/d4205e63-79f8-4bda-861a-5402609c037f-kube-api-access-swqp8\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.772241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.772223    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.772294 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.772235    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdpmc\" (UniqueName: \"kubernetes.io/projected/77330f26-0bd9-4176-86b7-780fed040b10-kube-api-access-mdpmc\") pod \"cluster-samples-operator-6ddb6c8b94-l4dzs\" (UID: \"77330f26-0bd9-4176-86b7-780fed040b10\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-l4dzs"
Oct 31 00:14:59.772294 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.772273    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49spz\" (UniqueName: \"kubernetes.io/projected/0347cd21-2175-4a7c-8a9c-239cf3b5a392-kube-api-access-49spz\") pod \"network-check-source-6f78d59f99-9lx75\" (UID: \"0347cd21-2175-4a7c-8a9c-239cf3b5a392\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-9lx75"
Oct 31 00:14:59.772902 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.772886    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr2f5\" (UniqueName: \"kubernetes.io/projected/462389b8-254c-4f99-ac14-5b66525f62dd-kube-api-access-qr2f5\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.773562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.773541    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5d5\" (UniqueName: \"kubernetes.io/projected/6bbd3db6-4290-4d6c-9735-519c8585376b-kube-api-access-mw5d5\") pod \"kas-connection-checker-685895c7c9-sxf6j\" (UID: \"6bbd3db6-4290-4d6c-9735-519c8585376b\") " pod="kube-system/kas-connection-checker-685895c7c9-sxf6j"
Oct 31 00:14:59.773869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.773854    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgxj\" (UniqueName: \"kubernetes.io/projected/e6e98896-64cd-4abd-94ef-a95f65f5d05d-kube-api-access-7sgxj\") pod \"network-check-target-jxpcb\" (UID: \"e6e98896-64cd-4abd-94ef-a95f65f5d05d\") " pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:14:59.775443 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.775409    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-942jl\" (UniqueName: \"kubernetes.io/projected/4c43a258-8b6a-4d05-a56f-dfd659fc37d8-kube-api-access-942jl\") pod \"network-metrics-daemon-5725k\" (UID: \"4c43a258-8b6a-4d05-a56f-dfd659fc37d8\") " pod="openshift-multus/network-metrics-daemon-5725k"
Oct 31 00:14:59.778830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.778813    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ht4s\" (UniqueName: \"kubernetes.io/projected/7d998f53-1c5a-4144-880c-4c69c558ab97-kube-api-access-5ht4s\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.779057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.779042    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkc48\" (UniqueName: \"kubernetes.io/projected/ae27e7a7-3d44-45dc-a232-4e85a5027a12-kube-api-access-mkc48\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.779918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.779902    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j7ml\" (UniqueName: \"kubernetes.io/projected/55ad7d0d-4b43-4377-ab24-9d4768c82cef-kube-api-access-4j7ml\") pod \"ingress-canary-gzr86\" (UID: \"55ad7d0d-4b43-4377-ab24-9d4768c82cef\") " pod="openshift-ingress-canary/ingress-canary-gzr86"
Oct 31 00:14:59.780684 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.780665    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7ph\" (UniqueName: \"kubernetes.io/projected/6a6dde53-407d-43ce-84df-30c1a1e08580-kube-api-access-lf7ph\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.780815 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.780800    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8m4c\" (UniqueName: \"kubernetes.io/projected/3734cc90-7907-4498-9a6b-7bae4757ff0b-kube-api-access-v8m4c\") pod \"console-operator-7cd56b8dbc-crbc6\" (UID: \"3734cc90-7907-4498-9a6b-7bae4757ff0b\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:14:59.780966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.780952    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dq55\" (UniqueName: \"kubernetes.io/projected/07c85ed3-44fd-4fb8-824f-468184be0d4d-kube-api-access-2dq55\") pod \"volume-data-source-validator-58c9f5f46d-h88qb\" (UID: \"07c85ed3-44fd-4fb8-824f-468184be0d4d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-h88qb"
Oct 31 00:14:59.783345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.783325    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qb9k\" (UniqueName: \"kubernetes.io/projected/171545bb-2c69-4ce1-828c-539f326f1c37-kube-api-access-5qb9k\") pod \"service-ca-operator-544d749c8c-dmj27\" (UID: \"171545bb-2c69-4ce1-828c-539f326f1c37\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27"
Oct 31 00:14:59.784192 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.784173    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgkm\" (UniqueName: \"kubernetes.io/projected/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-kube-api-access-nkgkm\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.784568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.784551    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") pod \"periodic-gathering-mjrm9-mxnnz\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") " pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:14:59.785003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.784983    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s7h\" (UniqueName: \"kubernetes.io/projected/46929db8-c3de-4e58-90e3-3099456b9018-kube-api-access-n9s7h\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.785348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.785330    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrlst\" (UniqueName: \"kubernetes.io/projected/e0762913-8550-41b9-a1a8-d2df14f88004-kube-api-access-qrlst\") pod \"kas-connection-checker-685895c7c9-7j8dt\" (UID: \"e0762913-8550-41b9-a1a8-d2df14f88004\") " pod="kube-system/kas-connection-checker-685895c7c9-7j8dt"
Oct 31 00:14:59.787501 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.787486    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8lrp\" (UniqueName: \"kubernetes.io/projected/9cd937ab-d46d-4bff-8049-485b18bfdb6c-kube-api-access-m8lrp\") pod \"kas-connection-checker-685895c7c9-k6mcf\" (UID: \"9cd937ab-d46d-4bff-8049-485b18bfdb6c\") " pod="kube-system/kas-connection-checker-685895c7c9-k6mcf"
Oct 31 00:14:59.792108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.792093    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") pod \"image-registry-567894c8cd-bksgp\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") " pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:14:59.794033 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.794017    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9s6\" (UniqueName: \"kubernetes.io/projected/f53d8e59-7949-41f4-a271-1f6bf7288552-kube-api-access-jq9s6\") pod \"dns-default-q5zwx\" (UID: \"f53d8e59-7949-41f4-a271-1f6bf7288552\") " pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:14:59.796584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.796562    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgd7\" (UniqueName: \"kubernetes.io/projected/d2b34c50-498f-4371-b594-d3fd404192af-kube-api-access-6cgd7\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m\" (UID: \"d2b34c50-498f-4371-b594-d3fd404192af\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m"
Oct 31 00:14:59.796685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.796647    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbln\" (UniqueName: \"kubernetes.io/projected/aebe9cd7-a93e-4707-b53c-fdaeddc05258-kube-api-access-jxbln\") pod \"cluster-monitoring-operator-884576c57-tlc2z\" (UID: \"aebe9cd7-a93e-4707-b53c-fdaeddc05258\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tlc2z"
Oct 31 00:14:59.796743 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.796683    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f5b\" (UniqueName: \"kubernetes.io/projected/46f076a2-ab34-4a66-a113-66fa2291345d-kube-api-access-97f5b\") pod \"insights-operator-7c4986d449-rt22m\" (UID: \"46f076a2-ab34-4a66-a113-66fa2291345d\") " pod="openshift-insights/insights-operator-7c4986d449-rt22m"
Oct 31 00:14:59.798448 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.798408    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4zv5\" (UniqueName: \"kubernetes.io/projected/b899807e-b82b-4d93-b1b7-ce371ff91281-kube-api-access-l4zv5\") pod \"router-default-7c7d9879df-g4m8t\" (UID: \"b899807e-b82b-4d93-b1b7-ce371ff91281\") " pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:14:59.821146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821126    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-lib-modules\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821157    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-systemd-units\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821185    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-slash\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821202    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-log-socket\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821239    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-systemd-units\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821250    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-log-socket\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821251    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-slash\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821271    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-node-log\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821283    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-lib-modules\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821297    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cnibin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821303    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-node-log\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821329    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-ovn\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821348    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821358    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-cnibin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821362    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysconfig\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821389    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-device-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821398    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysconfig\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821427    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821451    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-ovn\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821451    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821485    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a6dde53-407d-43ce-84df-30c1a1e08580-hosts-file\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.821500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821500    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-modprobe-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821538    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-multus\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821560    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-device-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821569    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821578    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-modprobe-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821565    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a6dde53-407d-43ce-84df-30c1a1e08580-hosts-file\") pod \"node-resolver-6cjm6\" (UID: \"6a6dde53-407d-43ce-84df-30c1a1e08580\") " pod="openshift-dns/node-resolver-6cjm6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821616    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-multus\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821639    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-netns\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821668    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-k8s-cni-cncf-io\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821683    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40109db6-b298-4a83-af09-889703196f40-crio-socket\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821699    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-kubelet-config\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821716    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-socket-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821718    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-netns\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821743    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-k8s-cni-cncf-io\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821749    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-cnibin\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821763    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40109db6-b298-4a83-af09-889703196f40-crio-socket\") pod \"insights-runtime-extractor-ww2hz\" (UID: \"40109db6-b298-4a83-af09-889703196f40\") " pod="openshift-insights/insights-runtime-extractor-ww2hz"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821767    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-socket-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821774    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-kubelet-config\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821778    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821781    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-cnibin\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821804    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-host\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821819    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-dbus\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821834    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821837    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-host\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821856    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-d\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.821866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821857    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-systemd\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821881    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6362fc09-4b02-49dd-8e75-db40d935cc71-dbus\") pod \"global-pull-secret-syncer-65fz2\" (UID: \"6362fc09-4b02-49dd-8e75-db40d935cc71\") " pod="kube-system/global-pull-secret-syncer-65fz2"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821879    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821893    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-systemd\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821899    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-etc-kubernetes\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821882    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-etc-kubernetes\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821921    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-system-cni-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821939    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-system-cni-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821935    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-sys\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821969    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-hostroot\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821980    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-sys\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.821991    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-bin\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822007    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-socket-dir-parent\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822017    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-hostroot\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822022    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-conf-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822042    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-conf-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822042    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-bin\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822056    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822060    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-socket-dir-parent\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822075    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-conf\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822091    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-netns\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822104    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-run\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822092    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822136    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-netns\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822157    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-kubernetes\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822189    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-systemd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822189    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-kubernetes\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822157    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-run\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822209    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-var-lib-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822226    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-etc-sysctl-conf\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822238    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-var-lib-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822245    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-run-systemd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822251    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-kubelet\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822276    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d998f53-1c5a-4144-880c-4c69c558ab97-host\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822291    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4205e63-79f8-4bda-861a-5402609c037f-host-slash\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822309    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-kubelet\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822322    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-kubelet\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822331    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4205e63-79f8-4bda-861a-5402609c037f-host-slash\") pod \"iptables-alerter-xtq8q\" (UID: \"d4205e63-79f8-4bda-861a-5402609c037f\") " pod="openshift-network-operator/iptables-alerter-xtq8q"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822341    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-multus-certs\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822356    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d998f53-1c5a-4144-880c-4c69c558ab97-host\") pod \"node-ca-vxfn8\" (UID: \"7d998f53-1c5a-4144-880c-4c69c558ab97\") " pod="openshift-image-registry/node-ca-vxfn8"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822359    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-sys-fs\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822375    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-registration-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822425    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-registration-dir\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822409    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-run-multus-certs\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822432    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46929db8-c3de-4e58-90e3-3099456b9018-sys-fs\") pod \"aws-ebs-csi-driver-node-bfgn6\" (UID: \"46929db8-c3de-4e58-90e3-3099456b9018\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfgn6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822444    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-kubelet\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822447    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822477    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822495    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-multus-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822500    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-var-lib-kubelet\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822526    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-system-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822558    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae27e7a7-3d44-45dc-a232-4e85a5027a12-var-lib-kubelet\") pod \"tuned-89qld\" (UID: \"ae27e7a7-3d44-45dc-a232-4e85a5027a12\") " pod="openshift-cluster-node-tuning-operator/tuned-89qld"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822571    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822579    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822581    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-system-cni-dir\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822594    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-etc-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822616    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-etc-openvswitch\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822619    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-netd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822638    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-bin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822663    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6de17cd3-32c6-464e-97a6-e9d07f2dbfb0-host-cni-netd\") pod \"ovnkube-node-cq2q6\" (UID: \"6de17cd3-32c6-464e-97a6-e9d07f2dbfb0\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822674    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb-host-var-lib-cni-bin\") pod \"multus-zf867\" (UID: \"bfb7b42a-47a4-4f59-90a6-2c4c40ac55cb\") " pod="openshift-multus/multus-zf867"
Oct 31 00:14:59.822756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:14:59.822663    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/462389b8-254c-4f99-ac14-5b66525f62dd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnpg6\" (UID: \"462389b8-254c-4f99-ac14-5b66525f62dd\") " pod="openshift-multus/multus-additional-cni-plugins-nnpg6"
Oct 31 00:15:01.132830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.132802    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:15:01.539043 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.539010    5925 generic.go:356] "Generic (PLEG): container finished" podID="d2b34c50-498f-4371-b594-d3fd404192af" containerID="aef685df534edbb27bde389796bb12fdc922cf2c95dcfba4a38b028658df4a34" exitCode=0
Oct 31 00:15:01.539211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.539091    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m" event={"ID":"d2b34c50-498f-4371-b594-d3fd404192af","Type":"ContainerDied","Data":"aef685df534edbb27bde389796bb12fdc922cf2c95dcfba4a38b028658df4a34"}
Oct 31 00:15:01.539478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.539461    5925 scope.go:122] "RemoveContainer" containerID="aef685df534edbb27bde389796bb12fdc922cf2c95dcfba4a38b028658df4a34"
Oct 31 00:15:01.540804 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.540779    5925 generic.go:356] "Generic (PLEG): container finished" podID="46f076a2-ab34-4a66-a113-66fa2291345d" containerID="2550292bbb690679688ad89fe5ad5ef9b3ee2f4293ad222e695e23e752ff089c" exitCode=0
Oct 31 00:15:01.540878 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.540803    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-rt22m" event={"ID":"46f076a2-ab34-4a66-a113-66fa2291345d","Type":"ContainerDied","Data":"2550292bbb690679688ad89fe5ad5ef9b3ee2f4293ad222e695e23e752ff089c"}
Oct 31 00:15:01.541105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.541091    5925 scope.go:122] "RemoveContainer" containerID="2550292bbb690679688ad89fe5ad5ef9b3ee2f4293ad222e695e23e752ff089c"
Oct 31 00:15:01.542496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.542477    5925 generic.go:356] "Generic (PLEG): container finished" podID="171545bb-2c69-4ce1-828c-539f326f1c37" containerID="bdcf06a64994e43d7bffdd5f9be83339982c0bf5cab9d736685cf8b69e844f9d" exitCode=0
Oct 31 00:15:01.542594 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.542527    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27" event={"ID":"171545bb-2c69-4ce1-828c-539f326f1c37","Type":"ContainerDied","Data":"bdcf06a64994e43d7bffdd5f9be83339982c0bf5cab9d736685cf8b69e844f9d"}
Oct 31 00:15:01.542781 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.542768    5925 scope.go:122] "RemoveContainer" containerID="bdcf06a64994e43d7bffdd5f9be83339982c0bf5cab9d736685cf8b69e844f9d"
Oct 31 00:15:01.599355 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.599328    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:15:01.599644 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.599625    5925 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:15:01.601274 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:01.601249    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q5zwx"
Oct 31 00:15:02.550283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:02.550249    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-l5b6m" event={"ID":"d2b34c50-498f-4371-b594-d3fd404192af","Type":"ContainerStarted","Data":"33e74360976605b34b9daaf7ee30e09bad1b8810ab7258b9d9bf860bda2cc98c"}
Oct 31 00:15:02.552172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:02.552146    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-rt22m" event={"ID":"46f076a2-ab34-4a66-a113-66fa2291345d","Type":"ContainerStarted","Data":"eee2936742e55b8d579d26cda99060a8d5d1f576fc50d7abf377c5c0f14298e9"}
Oct 31 00:15:02.553712 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:02.553689    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-dmj27" event={"ID":"171545bb-2c69-4ce1-828c-539f326f1c37","Type":"ContainerStarted","Data":"2e171edeb95adaf98d2cf90bd1844c910e551493c709dce3d5e2c4613535fc28"}
Oct 31 00:15:04.278259 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.278229    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-krdbx"]
Oct 31 00:15:04.280639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.280622    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.336588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.336557    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 00:15:04.336588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.336560    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 00:15:04.344889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.344867    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 00:15:04.360384 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360361    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-textfile\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360391    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6f57022-10e3-4925-a7f4-06f81c377d46-metrics-client-ca\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360435    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360581 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360514    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6gqz\" (UniqueName: \"kubernetes.io/projected/d6f57022-10e3-4925-a7f4-06f81c377d46-kube-api-access-b6gqz\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360623 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360603    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-sys\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360655    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-tls\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360753 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360735    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-root\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360784    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-wtmp\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.360842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.360828    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-accelerators-collector-config\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.382771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.382745    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ks82c\""
Oct 31 00:15:04.382866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.382842    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 00:15:04.461920 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.461890    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-sys\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.461953    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-tls\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.461986    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-root\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462002    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-sys\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462018    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-wtmp\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462056    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-accelerators-collector-config\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462090    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-root\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462093    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-textfile\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462138    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-wtmp\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462153    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6f57022-10e3-4925-a7f4-06f81c377d46-metrics-client-ca\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462190    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462217    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6gqz\" (UniqueName: \"kubernetes.io/projected/d6f57022-10e3-4925-a7f4-06f81c377d46-kube-api-access-b6gqz\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462360    5925 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 00:15:04.462822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462801    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6f57022-10e3-4925-a7f4-06f81c377d46-metrics-client-ca\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462929 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462908    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-accelerators-collector-config\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.462929 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.462922    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-textfile\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.464673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.464643    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.464673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.464664    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6f57022-10e3-4925-a7f4-06f81c377d46-node-exporter-tls\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.520885 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.520845    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6gqz\" (UniqueName: \"kubernetes.io/projected/d6f57022-10e3-4925-a7f4-06f81c377d46-kube-api-access-b6gqz\") pod \"node-exporter-krdbx\" (UID: \"d6f57022-10e3-4925-a7f4-06f81c377d46\") " pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.594495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.594465    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krdbx"
Oct 31 00:15:04.605359 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:15:04.605329    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f57022_10e3_4925_a7f4_06f81c377d46.slice/crio-cdc23c360122c800695fcfaf33f31ea83d2ad785db17a13830768f02613e87ae WatchSource:0}: Error finding container cdc23c360122c800695fcfaf33f31ea83d2ad785db17a13830768f02613e87ae: Status 404 returned error can't find the container with id cdc23c360122c800695fcfaf33f31ea83d2ad785db17a13830768f02613e87ae
Oct 31 00:15:04.607494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.607477    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:15:04.965859 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.965778    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:15:04.969494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:04.969470    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-crbc6"
Oct 31 00:15:05.567308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:05.567254    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdbx" event={"ID":"d6f57022-10e3-4925-a7f4-06f81c377d46","Type":"ContainerStarted","Data":"cdc23c360122c800695fcfaf33f31ea83d2ad785db17a13830768f02613e87ae"}
Oct 31 00:15:05.679731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:05.679700    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-slhsd"
Oct 31 00:15:06.572480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:06.572441    5925 generic.go:356] "Generic (PLEG): container finished" podID="d6f57022-10e3-4925-a7f4-06f81c377d46" containerID="08059cd188cefd7d72671e377f64d3f04e86d3a36a8c85b7fc7569dde8650f15" exitCode=0
Oct 31 00:15:06.572898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:06.572533    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdbx" event={"ID":"d6f57022-10e3-4925-a7f4-06f81c377d46","Type":"ContainerDied","Data":"08059cd188cefd7d72671e377f64d3f04e86d3a36a8c85b7fc7569dde8650f15"}
Oct 31 00:15:06.589764 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:06.589737    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxpcb"
Oct 31 00:15:06.795372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:06.795340    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-567894c8cd-bksgp"]
Oct 31 00:15:06.799883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:06.799850    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:15:07.577347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:07.577316    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c7d9879df-g4m8t"
Oct 31 00:15:07.578511 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:07.578487    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdbx" event={"ID":"d6f57022-10e3-4925-a7f4-06f81c377d46","Type":"ContainerStarted","Data":"44e08e0b96ebc33db768da4c018ae01c9fa8bde61466cb28696ef6a18052723c"}
Oct 31 00:15:07.578592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:07.578538    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krdbx" event={"ID":"d6f57022-10e3-4925-a7f4-06f81c377d46","Type":"ContainerStarted","Data":"b546b07491ebc2677c59728ce3b3b99d5afa818efa27f4a1140ef214c489dfda"}
Oct 31 00:15:07.695814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:07.695769    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-krdbx" podStartSLOduration=1.8660787380000001 podStartE2EDuration="3.695757168s" totalImagesPullingTime="1.76011311s" totalInitContainerRuntime="69.56532ms" isStatefulPod=true podCreationTimestamp="2026-10-31 00:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:15:07.695596778 +0000 UTC m=+9.384476724" watchObservedRunningTime="2026-10-31 00:15:07.695757168 +0000 UTC m=+9.384637114"
Oct 31 00:15:16.541199 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:15:16.541163    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:15:16.790215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:16.790179    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-mjrm9-mxnnz"]
Oct 31 00:15:16.790441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:16.790384    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz" podUID="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" containerName="insights-gathering" containerID="cri-o://f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32" gracePeriod=30
Oct 31 00:15:17.056999 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.056946    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:15:17.168364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.168326    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") pod \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") "
Oct 31 00:15:17.168562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.168385    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") pod \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") "
Oct 31 00:15:17.168562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.168475    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") pod \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") "
Oct 31 00:15:17.168562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.168522    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") pod \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\" (UID: \"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b\") "
Oct 31 00:15:17.168766 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.168737    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path" pod "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" (UID: "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:15:17.169149 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.169123    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle" pod "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" (UID: "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:17.169281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.169218    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle" pod "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" (UID: "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:17.171266 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.171238    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx" pod "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" (UID: "90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b"). InnerVolumeSpecName "kube-api-access-2grhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:17.269933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.269904    5925 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-archives-path\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:17.269933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.269928    5925 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-service-ca-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:17.269933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.269938    5925 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-trusted-ca-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:17.270163 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.269947    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2grhx\" (UniqueName: \"kubernetes.io/projected/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b-kube-api-access-2grhx\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:17.614802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.614766    5925 generic.go:356] "Generic (PLEG): container finished" podID="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" containerID="f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32" exitCode=2
Oct 31 00:15:17.614802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.614806    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz" event={"ID":"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b","Type":"ContainerDied","Data":"f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32"}
Oct 31 00:15:17.615215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.614847    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz" event={"ID":"90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b","Type":"ContainerDied","Data":"227df5841285f25bc8e170e44eef5e4f8cfd62637ccaec724a04b4efb73879b7"}
Oct 31 00:15:17.615215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.614869    5925 scope.go:122] "RemoveContainer" containerID="f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32"
Oct 31 00:15:17.615215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.614874    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-mjrm9-mxnnz"
Oct 31 00:15:17.623623 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.623603    5925 scope.go:122] "RemoveContainer" containerID="f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32"
Oct 31 00:15:17.623901 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:15:17.623880    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32\": container with ID starting with f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32 not found: ID does not exist" containerID="f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32"
Oct 31 00:15:17.624016 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.623915    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32"} err="failed to get container status \"f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32\": rpc error: code = NotFound desc = could not find container \"f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32\": container with ID starting with f624c21b23d1996865e3a85f6e8ee17fdb625d41c0d60183feaff98f5bc10f32 not found: ID does not exist"
Oct 31 00:15:17.770170 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.770140    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-mjrm9-mxnnz"]
Oct 31 00:15:17.818161 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:17.818130    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-mjrm9-mxnnz"]
Oct 31 00:15:18.449698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:18.449669    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" path="/var/lib/kubelet/pods/90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b/volumes"
Oct 31 00:15:21.007559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:21.007526    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq2q6"
Oct 31 00:15:31.815051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:31.815008    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-567894c8cd-bksgp" podUID="7729e485-91fd-498c-8927-db2c765a9357" containerName="registry" containerID="cri-o://ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c" gracePeriod=30
Oct 31 00:15:32.056223 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.056195    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:15:32.194105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194074    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194114    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194135    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194156    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194207    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194239    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194307    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194344    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") pod \"7729e485-91fd-498c-8927-db2c765a9357\" (UID: \"7729e485-91fd-498c-8927-db2c765a9357\") "
Oct 31 00:15:32.194653 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194553    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:32.194790 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.194760    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:15:32.197023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.196968    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:15:32.197146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.197118    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:15:32.197320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.197287    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:32.197320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.197299    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "kube-api-access-jrbks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:32.197842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.197352    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:15:32.201473 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.201450    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted" pod "7729e485-91fd-498c-8927-db2c765a9357" (UID: "7729e485-91fd-498c-8927-db2c765a9357"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:15:32.295198 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295167    5925 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-trusted-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295198 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295197    5925 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7729e485-91fd-498c-8927-db2c765a9357-registry-certificates\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295208    5925 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7729e485-91fd-498c-8927-db2c765a9357-ca-trust-extracted\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295217    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrbks\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-kube-api-access-jrbks\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295227    5925 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-installation-pull-secrets\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295236    5925 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-registry-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295245    5925 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7729e485-91fd-498c-8927-db2c765a9357-image-registry-private-configuration\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.295372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.295253    5925 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7729e485-91fd-498c-8927-db2c765a9357-bound-sa-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:15:32.668145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.668109    5925 generic.go:356] "Generic (PLEG): container finished" podID="7729e485-91fd-498c-8927-db2c765a9357" containerID="ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c" exitCode=0
Oct 31 00:15:32.668325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.668158    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567894c8cd-bksgp"
Oct 31 00:15:32.668325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.668176    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567894c8cd-bksgp" event={"ID":"7729e485-91fd-498c-8927-db2c765a9357","Type":"ContainerDied","Data":"ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c"}
Oct 31 00:15:32.668325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.668225    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567894c8cd-bksgp" event={"ID":"7729e485-91fd-498c-8927-db2c765a9357","Type":"ContainerDied","Data":"c1aff98d68145475560d17b5fa33e182c555d09cd3d4b300aa8530876b450fbd"}
Oct 31 00:15:32.668325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.668254    5925 scope.go:122] "RemoveContainer" containerID="ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c"
Oct 31 00:15:32.676211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.676190    5925 scope.go:122] "RemoveContainer" containerID="ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c"
Oct 31 00:15:32.676487 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:15:32.676466    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c\": container with ID starting with ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c not found: ID does not exist" containerID="ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c"
Oct 31 00:15:32.676585 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.676493    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c"} err="failed to get container status \"ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c\": rpc error: code = NotFound desc = could not find container \"ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c\": container with ID starting with ce12187a7f778e4e6eee509ffed8b0dbe69f6b5b030cce0562892a2ed9ceb91c not found: ID does not exist"
Oct 31 00:15:32.828174 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.828103    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-567894c8cd-bksgp"]
Oct 31 00:15:32.833286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:32.833263    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-567894c8cd-bksgp"]
Oct 31 00:15:34.453110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:15:34.453079    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7729e485-91fd-498c-8927-db2c765a9357" path="/var/lib/kubelet/pods/7729e485-91fd-498c-8927-db2c765a9357/volumes"
Oct 31 00:15:46.540079 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:15:46.540042    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:16:16.541362 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:16:16.541319    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:16:46.540841 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:16:46.540805    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:17:16.541067 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:17:16.541021    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:17:46.541807 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:17:46.541762    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:18:16.541215 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:18:16.541135    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:18:46.540297 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:18:46.540261    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:19:16.540369 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:19:16.540328    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:19:46.541165 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:19:46.541125    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:19:53.365756 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.365725    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"]
Oct 31 00:19:53.366129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.366000    5925 cpu_manager.go:414] "containerMap: removing container" podUID="7729e485-91fd-498c-8927-db2c765a9357" containerName="registry"
Oct 31 00:19:53.366129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.366011    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7729e485-91fd-498c-8927-db2c765a9357" containerName="registry"
Oct 31 00:19:53.366129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.366030    5925 cpu_manager.go:414] "containerMap: removing container" podUID="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" containerName="insights-gathering"
Oct 31 00:19:53.366129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.366035    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" containerName="insights-gathering"
Oct 31 00:19:53.366129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.366089    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="7729e485-91fd-498c-8927-db2c765a9357" containerName="registry"
Oct 31 00:19:53.366129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.366099    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="90debb7c-520b-4a8f-a8ba-dbd1cb11bf5b" containerName="insights-gathering"
Oct 31 00:19:53.369041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.369021    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.467890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.467849    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 00:19:53.468046 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.467930    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-tj4lk\""
Oct 31 00:19:53.468046 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.468022    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 00:19:53.468596 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.468578    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"]
Oct 31 00:19:53.493584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.493563    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.493717 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.493607    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.493717 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.493632    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2dm\" (UniqueName: \"kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.594993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.594961    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.595172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.595049    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.595172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.595069    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2dm\" (UniqueName: \"kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.600726 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.595784    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.600726 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.595842    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.654464 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.654379    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2dm\" (UniqueName: \"kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:53.684205 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:53.684172    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:19:54.051661 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:54.051582    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"]
Oct 31 00:19:54.059191 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:54.059166    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ab708c_a0a7_4063_af35_2e07e3fa51e2.slice/crio-4a474c9b626205c42ea05d56991a5d7e69a99009c63692ed43287bf869cc72ba WatchSource:0}: Error finding container 4a474c9b626205c42ea05d56991a5d7e69a99009c63692ed43287bf869cc72ba: Status 404 returned error can't find the container with id 4a474c9b626205c42ea05d56991a5d7e69a99009c63692ed43287bf869cc72ba
Oct 31 00:19:54.573063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:54.573029    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb" event={"ID":"f7ab708c-a0a7-4063-af35-2e07e3fa51e2","Type":"ContainerStarted","Data":"4a474c9b626205c42ea05d56991a5d7e69a99009c63692ed43287bf869cc72ba"}
Oct 31 00:19:55.804536 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.804503    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"]
Oct 31 00:19:55.808125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.808105    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:55.858179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.858154    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-pbccr\""
Oct 31 00:19:55.862638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.862611    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"]
Oct 31 00:19:55.896919 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.896886    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"]
Oct 31 00:19:55.900370 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.900344    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:55.912744 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.912721    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:55.912867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.912766    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4kf5\" (UniqueName: \"kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:55.912937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.912862    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:55.954865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.954833    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"]
Oct 31 00:19:55.958761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.958734    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-7frd5\""
Oct 31 00:19:55.992867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.992836    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"]
Oct 31 00:19:55.996462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:55.996441    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.013496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013472    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.013586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013507    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hzb\" (UniqueName: \"kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.013640 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013583    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.013640 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013616    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.013741 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013641    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4kf5\" (UniqueName: \"kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.013741 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013669    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.013996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.013976    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.014062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.014032    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.050600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.050564    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"]
Oct 31 00:19:56.059108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.059039    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-9mqzj\""
Oct 31 00:19:56.072820 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.072794    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4kf5\" (UniqueName: \"kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.092716 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.092686    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"]
Oct 31 00:19:56.097285 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.097263    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.114159 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114133    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.114258 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114182    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.114258 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114212    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.114359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114272    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cklvr\" (UniqueName: \"kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.114441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114380    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.114502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114439    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hzb\" (UniqueName: \"kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.114617 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114597    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.114771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.114736    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.124104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.124083    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:19:56.154823 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.154705    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"]
Oct 31 00:19:56.160145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.160119    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-7xzn9\""
Oct 31 00:19:56.173252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.173224    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hzb\" (UniqueName: \"kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.215250 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215216    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.215383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215279    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.215383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215314    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cklvr\" (UniqueName: \"kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.215383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215360    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlrpl\" (UniqueName: \"kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.215580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215388    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.215580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215429    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.215705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215676    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.215828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.215764    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.218127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.218109    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:19:56.277147 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.277122    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cklvr\" (UniqueName: \"kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.313200 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.313138    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:19:56.316503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.316478    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlrpl\" (UniqueName: \"kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.316621 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.316517    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.316621 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.316537    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.316881 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.316861    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.316913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.316883    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.376042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.376016    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlrpl\" (UniqueName: \"kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.415747 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.415717    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:19:56.502922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.502892    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"]
Oct 31 00:19:56.510765 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:56.510732    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb29249_4c18_4f7b_8db8_9d3030d653b6.slice/crio-8831f2ec6b7a5ad624b62735656e48d0bd5992db46ef86dd15505c60cb5625bd WatchSource:0}: Error finding container 8831f2ec6b7a5ad624b62735656e48d0bd5992db46ef86dd15505c60cb5625bd: Status 404 returned error can't find the container with id 8831f2ec6b7a5ad624b62735656e48d0bd5992db46ef86dd15505c60cb5625bd
Oct 31 00:19:56.581885 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.581859    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" event={"ID":"ddb29249-4c18-4f7b-8db8-9d3030d653b6","Type":"ContainerStarted","Data":"8831f2ec6b7a5ad624b62735656e48d0bd5992db46ef86dd15505c60cb5625bd"}
Oct 31 00:19:56.609132 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.609102    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"]
Oct 31 00:19:56.617467 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:56.617436    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ad8d9e_18bf_473b_afd7_4dc5107883a1.slice/crio-e8970581f3ccf5a68b681db2d0ac4069c7504281d1d72f029d5ca27f42dc6a47 WatchSource:0}: Error finding container e8970581f3ccf5a68b681db2d0ac4069c7504281d1d72f029d5ca27f42dc6a47: Status 404 returned error can't find the container with id e8970581f3ccf5a68b681db2d0ac4069c7504281d1d72f029d5ca27f42dc6a47
Oct 31 00:19:56.683375 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.683348    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"]
Oct 31 00:19:56.691576 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:56.691545    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dbad7fd_ebff_4bc8_a11e_0ea20bbf7aa5.slice/crio-e94f90383febd15f756712c4bbc48ca2dc15df3c649cbe2a4087be374cfabe0a WatchSource:0}: Error finding container e94f90383febd15f756712c4bbc48ca2dc15df3c649cbe2a4087be374cfabe0a: Status 404 returned error can't find the container with id e94f90383febd15f756712c4bbc48ca2dc15df3c649cbe2a4087be374cfabe0a
Oct 31 00:19:56.788984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.788951    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"]
Oct 31 00:19:56.796938 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:56.796909    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e641df7_f8b9_4725_b438_1f9c862d2c9b.slice/crio-a4a8cbf9a16fb7236d258c21995de72e5b894ffb0c5367b30a62277239e56c97 WatchSource:0}: Error finding container a4a8cbf9a16fb7236d258c21995de72e5b894ffb0c5367b30a62277239e56c97: Status 404 returned error can't find the container with id a4a8cbf9a16fb7236d258c21995de72e5b894ffb0c5367b30a62277239e56c97
Oct 31 00:19:56.940901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.940797    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"]
Oct 31 00:19:56.947828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:56.947801    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.002307 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.002285    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-rqwz5\""
Oct 31 00:19:57.017064 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.017041    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"]
Oct 31 00:19:57.022712 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.022686    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.022829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.022714    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.022829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.022747    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9brs\" (UniqueName: \"kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.123775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.123734    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.123949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.123779    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.123949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.123824    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9brs\" (UniqueName: \"kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.124226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.124201    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.124293 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.124274    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.183580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.183552    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9brs\" (UniqueName: \"kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.229914 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.229830    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"]
Oct 31 00:19:57.233830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.233807    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.264875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.264847    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:19:57.284213 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.284174    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-cwcnd\""
Oct 31 00:19:57.292055 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.292034    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"]
Oct 31 00:19:57.327099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.326771    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.327099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.326845    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltxgq\" (UniqueName: \"kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.327099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.326953    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.428480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.428424    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.428678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.428511    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.428678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.428541    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxgq\" (UniqueName: \"kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.428833 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.428812    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.428908 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.428880    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.488332 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.488266    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltxgq\" (UniqueName: \"kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.552151 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.552123    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:19:57.588460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.588427    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd" event={"ID":"8e641df7-f8b9-4725-b438-1f9c862d2c9b","Type":"ContainerStarted","Data":"a4a8cbf9a16fb7236d258c21995de72e5b894ffb0c5367b30a62277239e56c97"}
Oct 31 00:19:57.589773 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.589741    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h" event={"ID":"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5","Type":"ContainerStarted","Data":"e94f90383febd15f756712c4bbc48ca2dc15df3c649cbe2a4087be374cfabe0a"}
Oct 31 00:19:57.591056 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.591030    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn" event={"ID":"03ad8d9e-18bf-473b-afd7-4dc5107883a1","Type":"ContainerStarted","Data":"e8970581f3ccf5a68b681db2d0ac4069c7504281d1d72f029d5ca27f42dc6a47"}
Oct 31 00:19:57.646320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.646290    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"]
Oct 31 00:19:57.650155 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:57.650128    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b86c55_f117_425f_abbc_a6473e496162.slice/crio-e9c7b368a78acfb75b25405daabc4096aa2fe51cfcef776f844a3cff101b9e59 WatchSource:0}: Error finding container e9c7b368a78acfb75b25405daabc4096aa2fe51cfcef776f844a3cff101b9e59: Status 404 returned error can't find the container with id e9c7b368a78acfb75b25405daabc4096aa2fe51cfcef776f844a3cff101b9e59
Oct 31 00:19:57.931569 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:57.931485    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"]
Oct 31 00:19:58.495486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:58.495454    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:19:58.497846 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:58.497823    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:19:58.597792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:58.597752    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht" event={"ID":"31b86c55-f117-425f-abbc-a6473e496162","Type":"ContainerStarted","Data":"e9c7b368a78acfb75b25405daabc4096aa2fe51cfcef776f844a3cff101b9e59"}
Oct 31 00:19:58.599142 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:58.599111    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" event={"ID":"45cb720a-5107-4a44-b1b4-e8205998ed3d","Type":"ContainerStarted","Data":"cbeafd6e14358684bad6727e56f3ee6981ba843e9caa154b06dcf8461607d327"}
Oct 31 00:19:59.053490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.051745    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"]
Oct 31 00:19:59.056805 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.055844    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.107354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.107273    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 00:19:59.131093 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.131032    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fxh6q\""
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.144798    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.144853    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.144884    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.144918    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.144946    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.145001    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn7hr\" (UniqueName: \"kubernetes.io/projected/f37e7568-ca40-42a9-aadc-bdb63bac1c52-kube-api-access-hn7hr\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.145031    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.145077    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.145326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.145104    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.159768 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.159739    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"]
Oct 31 00:19:59.245998 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.245952    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn7hr\" (UniqueName: \"kubernetes.io/projected/f37e7568-ca40-42a9-aadc-bdb63bac1c52-kube-api-access-hn7hr\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.245998 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.245992    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246018    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246039    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246075    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246093    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246114    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246142    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.246261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246170    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.247006 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.246792    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.247567 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.247273    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.247567 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.247495    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.247567 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.247496    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.247887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.247845    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.249642 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.249623    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.252600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.252578    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.324957 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.324003    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn7hr\" (UniqueName: \"kubernetes.io/projected/f37e7568-ca40-42a9-aadc-bdb63bac1c52-kube-api-access-hn7hr\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.339427 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.339383    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f37e7568-ca40-42a9-aadc-bdb63bac1c52-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-cnm9b\" (UID: \"f37e7568-ca40-42a9-aadc-bdb63bac1c52\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.373840 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.373760    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:19:59.898754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:19:59.898647    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"]
Oct 31 00:19:59.947013 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:19:59.946980    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf37e7568_ca40_42a9_aadc_bdb63bac1c52.slice/crio-1567f6a585df463670ed50cb0f1893be70ce5f5fb3f422b3657c61ff14c118ea WatchSource:0}: Error finding container 1567f6a585df463670ed50cb0f1893be70ce5f5fb3f422b3657c61ff14c118ea: Status 404 returned error can't find the container with id 1567f6a585df463670ed50cb0f1893be70ce5f5fb3f422b3657c61ff14c118ea
Oct 31 00:20:00.617101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:00.617055    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" event={"ID":"f37e7568-ca40-42a9-aadc-bdb63bac1c52","Type":"ContainerStarted","Data":"1567f6a585df463670ed50cb0f1893be70ce5f5fb3f422b3657c61ff14c118ea"}
Oct 31 00:20:08.688525 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:08.688490    5925 generic.go:356] "Generic (PLEG): container finished" podID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerID="eef6b2bec47041e19da1125f230f86665093884fc17d3bdeac40f16c5eb58a61" exitCode=0
Oct 31 00:20:08.689020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:08.688590    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb" event={"ID":"f7ab708c-a0a7-4063-af35-2e07e3fa51e2","Type":"ContainerDied","Data":"eef6b2bec47041e19da1125f230f86665093884fc17d3bdeac40f16c5eb58a61"}
Oct 31 00:20:08.689457 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:08.689437    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:20:08.998781 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:08.998740    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:20:08.998901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:08.998830    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:20:08.998901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:08.998869    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:20:09.697593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:09.697552    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" event={"ID":"f37e7568-ca40-42a9-aadc-bdb63bac1c52","Type":"ContainerStarted","Data":"5b1f3c92e8327a860d4af1568918e7d5548c8ffbc4a8b8faf3d46145f0a11498"}
Oct 31 00:20:10.375095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.375053    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:20:10.381985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.381683    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:20:10.546322 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.546261    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podStartSLOduration=2.504536354 podStartE2EDuration="11.546238783s" totalImagesPullingTime="9.041702429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:09.816327429 +0000 UTC m=+311.505207376" watchObservedRunningTime="2026-10-31 00:20:10.546238783 +0000 UTC m=+312.235118730"
Oct 31 00:20:10.714127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.714038    5925 generic.go:356] "Generic (PLEG): container finished" podID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerID="2b149f272ef022168c6c9569f6b9f42786af2b4ba7b39a4204df5a697ad4c28d" exitCode=0
Oct 31 00:20:10.715263 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.715186    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb" event={"ID":"f7ab708c-a0a7-4063-af35-2e07e3fa51e2","Type":"ContainerDied","Data":"2b149f272ef022168c6c9569f6b9f42786af2b4ba7b39a4204df5a697ad4c28d"}
Oct 31 00:20:10.715591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.715573    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:20:10.716640 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:10.716621    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:20:11.722116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:11.722076    5925 generic.go:356] "Generic (PLEG): container finished" podID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerID="41198e28458ed28a91a434a317863690f80a69051e07e8dd93dc5e8ea7faac6c" exitCode=0
Oct 31 00:20:11.722530 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:11.722245    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h" event={"ID":"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5","Type":"ContainerDied","Data":"41198e28458ed28a91a434a317863690f80a69051e07e8dd93dc5e8ea7faac6c"}
Oct 31 00:20:11.726645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:11.726598    5925 generic.go:356] "Generic (PLEG): container finished" podID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerID="73955951fe305f9cc78b142deb5fcd1de927764890e6f15fc230b52d707155f4" exitCode=0
Oct 31 00:20:11.727514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:11.727480    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd" event={"ID":"8e641df7-f8b9-4725-b438-1f9c862d2c9b","Type":"ContainerDied","Data":"73955951fe305f9cc78b142deb5fcd1de927764890e6f15fc230b52d707155f4"}
Oct 31 00:20:12.735835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:12.735793    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht" event={"ID":"31b86c55-f117-425f-abbc-a6473e496162","Type":"ContainerStarted","Data":"4e79236d5347bf50583255c946cbee54c783c811faaceaea159086b2062cad78"}
Oct 31 00:20:12.741880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:12.740952    5925 generic.go:356] "Generic (PLEG): container finished" podID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerID="b4dcc83eda15ff5064b4bfcc78c06f14accf1ef0375f74b9159d066a976045d3" exitCode=0
Oct 31 00:20:12.741880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:12.741052    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" event={"ID":"ddb29249-4c18-4f7b-8db8-9d3030d653b6","Type":"ContainerDied","Data":"b4dcc83eda15ff5064b4bfcc78c06f14accf1ef0375f74b9159d066a976045d3"}
Oct 31 00:20:13.747354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:13.747320    5925 generic.go:356] "Generic (PLEG): container finished" podID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerID="89f29d620b62e852c8ecc46869b864993fea64dda451be4474606c1bdabac039" exitCode=0
Oct 31 00:20:13.747889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:13.747409    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" event={"ID":"45cb720a-5107-4a44-b1b4-e8205998ed3d","Type":"ContainerDied","Data":"89f29d620b62e852c8ecc46869b864993fea64dda451be4474606c1bdabac039"}
Oct 31 00:20:13.749390 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:13.749367    5925 generic.go:356] "Generic (PLEG): container finished" podID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerID="08b50cbf744de337778b5bcaa70954dfd36e2e3510670f409db044e01e46d017" exitCode=0
Oct 31 00:20:13.749514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:13.749467    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn" event={"ID":"03ad8d9e-18bf-473b-afd7-4dc5107883a1","Type":"ContainerDied","Data":"08b50cbf744de337778b5bcaa70954dfd36e2e3510670f409db044e01e46d017"}
Oct 31 00:20:13.751363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:13.751328    5925 generic.go:356] "Generic (PLEG): container finished" podID="31b86c55-f117-425f-abbc-a6473e496162" containerID="4e79236d5347bf50583255c946cbee54c783c811faaceaea159086b2062cad78" exitCode=0
Oct 31 00:20:13.751465 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:13.751392    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht" event={"ID":"31b86c55-f117-425f-abbc-a6473e496162","Type":"ContainerDied","Data":"4e79236d5347bf50583255c946cbee54c783c811faaceaea159086b2062cad78"}
Oct 31 00:20:14.760641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:14.760474    5925 generic.go:356] "Generic (PLEG): container finished" podID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerID="b2cd18e5d52cb9c6b1a7c393a7e62a7110860339f50bd234f41df36bd0c6f34c" exitCode=0
Oct 31 00:20:14.760641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:14.760587    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd" event={"ID":"8e641df7-f8b9-4725-b438-1f9c862d2c9b","Type":"ContainerDied","Data":"b2cd18e5d52cb9c6b1a7c393a7e62a7110860339f50bd234f41df36bd0c6f34c"}
Oct 31 00:20:15.769065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:15.769025    5925 generic.go:356] "Generic (PLEG): container finished" podID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerID="b5e2b88168c86e41f292713115e5ea6333a951c18e58d3031df99f9769a2b516" exitCode=0
Oct 31 00:20:15.769561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:15.769104    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" event={"ID":"ddb29249-4c18-4f7b-8db8-9d3030d653b6","Type":"ContainerDied","Data":"b5e2b88168c86e41f292713115e5ea6333a951c18e58d3031df99f9769a2b516"}
Oct 31 00:20:15.772286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:15.772241    5925 generic.go:356] "Generic (PLEG): container finished" podID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerID="d1eeedaf3bfb7885bf131bc87a61fe27dc8d4268dbab9fc794ab77147a31cca5" exitCode=0
Oct 31 00:20:15.772363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:15.772294    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h" event={"ID":"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5","Type":"ContainerDied","Data":"d1eeedaf3bfb7885bf131bc87a61fe27dc8d4268dbab9fc794ab77147a31cca5"}
Oct 31 00:20:16.554042 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:20:16.553887    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:20:16.781689 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:16.781648    5925 generic.go:356] "Generic (PLEG): container finished" podID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerID="35f4eb81ba514649c03579c3b5b5b6c8cef86bb9940fe7f5e3517cde20465509" exitCode=0
Oct 31 00:20:16.782065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:16.781769    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn" event={"ID":"03ad8d9e-18bf-473b-afd7-4dc5107883a1","Type":"ContainerDied","Data":"35f4eb81ba514649c03579c3b5b5b6c8cef86bb9940fe7f5e3517cde20465509"}
Oct 31 00:20:18.795441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:18.795118    5925 generic.go:356] "Generic (PLEG): container finished" podID="31b86c55-f117-425f-abbc-a6473e496162" containerID="2eefee2b621208653f6327a9ce45d750dfdce878fc8e9f510563b1445e5c77ba" exitCode=0
Oct 31 00:20:18.795441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:18.795212    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht" event={"ID":"31b86c55-f117-425f-abbc-a6473e496162","Type":"ContainerDied","Data":"2eefee2b621208653f6327a9ce45d750dfdce878fc8e9f510563b1445e5c77ba"}
Oct 31 00:20:18.801647 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:18.800921    5925 generic.go:356] "Generic (PLEG): container finished" podID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerID="c3c5ed95e996aa2fe58fd0f6b6b48c6b64c5adc0e3e522eeae107be66396ae70" exitCode=0
Oct 31 00:20:18.801647 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:18.801020    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" event={"ID":"45cb720a-5107-4a44-b1b4-e8205998ed3d","Type":"ContainerDied","Data":"c3c5ed95e996aa2fe58fd0f6b6b48c6b64c5adc0e3e522eeae107be66396ae70"}
Oct 31 00:20:22.850523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:22.850095    5925 generic.go:356] "Generic (PLEG): container finished" podID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerID="d27c2dc129106da21c647e3a1c71ad9296d6858050ea69dda7f3ee80a2736d8e" exitCode=0
Oct 31 00:20:22.850523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:22.850153    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb" event={"ID":"f7ab708c-a0a7-4063-af35-2e07e3fa51e2","Type":"ContainerDied","Data":"d27c2dc129106da21c647e3a1c71ad9296d6858050ea69dda7f3ee80a2736d8e"}
Oct 31 00:20:23.867509 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:23.867472    5925 generic.go:356] "Generic (PLEG): container finished" podID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerID="281afaea7f7f12a3d69c3454975338591e71df1cf868399a79e479cd7bb3e9a5" exitCode=0
Oct 31 00:20:23.868460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:23.868172    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd" event={"ID":"8e641df7-f8b9-4725-b438-1f9c862d2c9b","Type":"ContainerDied","Data":"281afaea7f7f12a3d69c3454975338591e71df1cf868399a79e479cd7bb3e9a5"}
Oct 31 00:20:24.045916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.045844    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:20:24.087520 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.086715    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm\" (UniqueName: \"kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm\") pod \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") "
Oct 31 00:20:24.087520 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.086860    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle\") pod \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") "
Oct 31 00:20:24.087520 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.086889    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util\") pod \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\" (UID: \"f7ab708c-a0a7-4063-af35-2e07e3fa51e2\") "
Oct 31 00:20:24.087947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.087866    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle" pod "f7ab708c-a0a7-4063-af35-2e07e3fa51e2" (UID: "f7ab708c-a0a7-4063-af35-2e07e3fa51e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:24.092894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.092858    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm" pod "f7ab708c-a0a7-4063-af35-2e07e3fa51e2" (UID: "f7ab708c-a0a7-4063-af35-2e07e3fa51e2"). InnerVolumeSpecName "kube-api-access-nd2dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:24.094299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.094279    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util" pod "f7ab708c-a0a7-4063-af35-2e07e3fa51e2" (UID: "f7ab708c-a0a7-4063-af35-2e07e3fa51e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:24.187673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.187634    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:24.187673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.187674    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:24.187902 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.187692    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd2dm\" (UniqueName: \"kubernetes.io/projected/f7ab708c-a0a7-4063-af35-2e07e3fa51e2-kube-api-access-nd2dm\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:24.876252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.876220    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" event={"ID":"ddb29249-4c18-4f7b-8db8-9d3030d653b6","Type":"ContainerStarted","Data":"a1902366dcfad61e3a706a402dbb34a132704e08515e4319f03c750383811105"}
Oct 31 00:20:24.878992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.878963    5925 generic.go:356] "Generic (PLEG): container finished" podID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerID="07e8ce9215c39920fc1a527b05cf71c97e8bb472ed49ad372c66f20896045534" exitCode=0
Oct 31 00:20:24.879104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.879047    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h" event={"ID":"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5","Type":"ContainerDied","Data":"07e8ce9215c39920fc1a527b05cf71c97e8bb472ed49ad372c66f20896045534"}
Oct 31 00:20:24.881384 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.881363    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb"
Oct 31 00:20:24.881523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.881377    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71s4jmb" event={"ID":"f7ab708c-a0a7-4063-af35-2e07e3fa51e2","Type":"ContainerDied","Data":"4a474c9b626205c42ea05d56991a5d7e69a99009c63692ed43287bf869cc72ba"}
Oct 31 00:20:24.881523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.881438    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a474c9b626205c42ea05d56991a5d7e69a99009c63692ed43287bf869cc72ba"
Oct 31 00:20:24.993450 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:24.990625    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" podStartSLOduration=3.315749327 podStartE2EDuration="29.990576121s" totalImagesPullingTime="26.674826794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:19:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:24.990327705 +0000 UTC m=+326.679207652" watchObservedRunningTime="2026-10-31 00:20:24.990576121 +0000 UTC m=+326.679456088"
Oct 31 00:20:25.083938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.083908    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:20:25.197359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.197280    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl\" (UniqueName: \"kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl\") pod \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") "
Oct 31 00:20:25.197539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.197392    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle\") pod \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") "
Oct 31 00:20:25.197539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.197475    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util\") pod \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\" (UID: \"8e641df7-f8b9-4725-b438-1f9c862d2c9b\") "
Oct 31 00:20:25.198461 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.198407    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle" pod "8e641df7-f8b9-4725-b438-1f9c862d2c9b" (UID: "8e641df7-f8b9-4725-b438-1f9c862d2c9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:25.200604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.200571    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl" pod "8e641df7-f8b9-4725-b438-1f9c862d2c9b" (UID: "8e641df7-f8b9-4725-b438-1f9c862d2c9b"). InnerVolumeSpecName "kube-api-access-zlrpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:25.204340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.204307    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util" pod "8e641df7-f8b9-4725-b438-1f9c862d2c9b" (UID: "8e641df7-f8b9-4725-b438-1f9c862d2c9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:25.298495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.298459    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:25.298495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.298494    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlrpl\" (UniqueName: \"kubernetes.io/projected/8e641df7-f8b9-4725-b438-1f9c862d2c9b-kube-api-access-zlrpl\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:25.298687 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.298511    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e641df7-f8b9-4725-b438-1f9c862d2c9b-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:25.889995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.889957    5925 generic.go:356] "Generic (PLEG): container finished" podID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerID="a1902366dcfad61e3a706a402dbb34a132704e08515e4319f03c750383811105" exitCode=0
Oct 31 00:20:25.890391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.890042    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" event={"ID":"ddb29249-4c18-4f7b-8db8-9d3030d653b6","Type":"ContainerDied","Data":"a1902366dcfad61e3a706a402dbb34a132704e08515e4319f03c750383811105"}
Oct 31 00:20:25.892382 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.892358    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd"
Oct 31 00:20:25.892382 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.892364    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc9wnd" event={"ID":"8e641df7-f8b9-4725-b438-1f9c862d2c9b","Type":"ContainerDied","Data":"a4a8cbf9a16fb7236d258c21995de72e5b894ffb0c5367b30a62277239e56c97"}
Oct 31 00:20:25.892558 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.892422    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4a8cbf9a16fb7236d258c21995de72e5b894ffb0c5367b30a62277239e56c97"
Oct 31 00:20:25.894993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.894968    5925 generic.go:356] "Generic (PLEG): container finished" podID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerID="95e7a4cea43c894f5697b0c6d9cdc2ece6cf8df1fed471fe2d96cb4c48b2a450" exitCode=0
Oct 31 00:20:25.895116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:25.895056    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn" event={"ID":"03ad8d9e-18bf-473b-afd7-4dc5107883a1","Type":"ContainerDied","Data":"95e7a4cea43c894f5697b0c6d9cdc2ece6cf8df1fed471fe2d96cb4c48b2a450"}
Oct 31 00:20:26.063990 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.063964    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:20:26.103541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.103499    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr\" (UniqueName: \"kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr\") pod \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") "
Oct 31 00:20:26.103706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.103575    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util\") pod \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") "
Oct 31 00:20:26.103706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.103660    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle\") pod \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\" (UID: \"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5\") "
Oct 31 00:20:26.104161 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.104124    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle" pod "8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" (UID: "8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:26.106136 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.106104    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr" pod "8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" (UID: "8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5"). InnerVolumeSpecName "kube-api-access-cklvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:26.110102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.110073    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util" pod "8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" (UID: "8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:26.205289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.205210    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cklvr\" (UniqueName: \"kubernetes.io/projected/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-kube-api-access-cklvr\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:26.205289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.205244    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:26.205289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.205258    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:26.901456 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.901401    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" event={"ID":"45cb720a-5107-4a44-b1b4-e8205998ed3d","Type":"ContainerStarted","Data":"4c66a51d5d4fe88e6ca47ac5dd62c9a66dcfa84880433067a7e2aded7b5091eb"}
Oct 31 00:20:26.908159 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.908128    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h" event={"ID":"8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5","Type":"ContainerDied","Data":"e94f90383febd15f756712c4bbc48ca2dc15df3c649cbe2a4087be374cfabe0a"}
Oct 31 00:20:26.908291 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.908181    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e94f90383febd15f756712c4bbc48ca2dc15df3c649cbe2a4087be374cfabe0a"
Oct 31 00:20:26.908291 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.908135    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65cq9h"
Oct 31 00:20:26.910792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.910765    5925 generic.go:356] "Generic (PLEG): container finished" podID="31b86c55-f117-425f-abbc-a6473e496162" containerID="177e809b9c911b12d63cc7c450e4d9926158be6e51fd25a5936ab0970b8a0646" exitCode=0
Oct 31 00:20:26.910898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:26.910799    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht" event={"ID":"31b86c55-f117-425f-abbc-a6473e496162","Type":"ContainerDied","Data":"177e809b9c911b12d63cc7c450e4d9926158be6e51fd25a5936ab0970b8a0646"}
Oct 31 00:20:27.019937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.019889    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" podStartSLOduration=2.630423431 podStartE2EDuration="30.019874116s" totalImagesPullingTime="27.389450685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:19:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:27.019371973 +0000 UTC m=+328.708251922" watchObservedRunningTime="2026-10-31 00:20:27.019874116 +0000 UTC m=+328.708754061"
Oct 31 00:20:27.046837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.046811    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:20:27.051579 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.051560    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:20:27.111821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.111792    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle\") pod \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") "
Oct 31 00:20:27.111965 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.111882    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle\") pod \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") "
Oct 31 00:20:27.112055 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.111976    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb\" (UniqueName: \"kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb\") pod \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") "
Oct 31 00:20:27.112055 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.112021    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5\" (UniqueName: \"kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5\") pod \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") "
Oct 31 00:20:27.112165 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.112076    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util\") pod \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\" (UID: \"ddb29249-4c18-4f7b-8db8-9d3030d653b6\") "
Oct 31 00:20:27.112165 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.112127    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util\") pod \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\" (UID: \"03ad8d9e-18bf-473b-afd7-4dc5107883a1\") "
Oct 31 00:20:27.112377 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.112341    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle" pod "ddb29249-4c18-4f7b-8db8-9d3030d653b6" (UID: "ddb29249-4c18-4f7b-8db8-9d3030d653b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:27.114573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.114535    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle" pod "03ad8d9e-18bf-473b-afd7-4dc5107883a1" (UID: "03ad8d9e-18bf-473b-afd7-4dc5107883a1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:27.115165 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.115130    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5" pod "ddb29249-4c18-4f7b-8db8-9d3030d653b6" (UID: "ddb29249-4c18-4f7b-8db8-9d3030d653b6"). InnerVolumeSpecName "kube-api-access-q4kf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:27.118452 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.118425    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util" pod "ddb29249-4c18-4f7b-8db8-9d3030d653b6" (UID: "ddb29249-4c18-4f7b-8db8-9d3030d653b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:27.119727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.119699    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util" pod "03ad8d9e-18bf-473b-afd7-4dc5107883a1" (UID: "03ad8d9e-18bf-473b-afd7-4dc5107883a1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:27.121032 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.121004    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb" pod "03ad8d9e-18bf-473b-afd7-4dc5107883a1" (UID: "03ad8d9e-18bf-473b-afd7-4dc5107883a1"). InnerVolumeSpecName "kube-api-access-56hzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:27.212888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.212810    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:27.212888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.212835    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:27.212888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.212844    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ddb29249-4c18-4f7b-8db8-9d3030d653b6-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:27.212888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.212853    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03ad8d9e-18bf-473b-afd7-4dc5107883a1-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:27.212888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.212882    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56hzb\" (UniqueName: \"kubernetes.io/projected/03ad8d9e-18bf-473b-afd7-4dc5107883a1-kube-api-access-56hzb\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:27.212888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.212892    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4kf5\" (UniqueName: \"kubernetes.io/projected/ddb29249-4c18-4f7b-8db8-9d3030d653b6-kube-api-access-q4kf5\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:27.297493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297457    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"]
Oct 31 00:20:27.297823 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297809    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="extract"
Oct 31 00:20:27.297869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297825    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="extract"
Oct 31 00:20:27.297869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297838    5925 cpu_manager.go:414] "containerMap: removing container" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="util"
Oct 31 00:20:27.297869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297844    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="util"
Oct 31 00:20:27.297869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297859    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="util"
Oct 31 00:20:27.297869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297864    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="util"
Oct 31 00:20:27.297869 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297870    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297875    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297882    5925 cpu_manager.go:414] "containerMap: removing container" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297886    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297894    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="util"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297899    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="util"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297904    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297908    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297914    5925 cpu_manager.go:414] "containerMap: removing container" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297918    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297923    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="util"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297927    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="util"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297933    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="util"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297937    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="util"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297949    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297955    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297962    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297967    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297972    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297976    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="pull"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297982    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297986    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.297996    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="extract"
Oct 31 00:20:27.298036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.298001    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="extract"
Oct 31 00:20:27.298664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.298061    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7ab708c-a0a7-4063-af35-2e07e3fa51e2" containerName="extract"
Oct 31 00:20:27.298664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.298068    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="03ad8d9e-18bf-473b-afd7-4dc5107883a1" containerName="extract"
Oct 31 00:20:27.298664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.298078    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e641df7-f8b9-4725-b438-1f9c862d2c9b" containerName="extract"
Oct 31 00:20:27.298664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.298083    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ddb29249-4c18-4f7b-8db8-9d3030d653b6" containerName="extract"
Oct 31 00:20:27.298664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.298088    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="8dbad7fd-ebff-4bc8-a11e-0ea20bbf7aa5" containerName="extract"
Oct 31 00:20:27.301215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.301196    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.369386 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.369357    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 31 00:20:27.369386 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.369367    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 31 00:20:27.369556 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.369542    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 31 00:20:27.369641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.369630    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-vk4k4\""
Oct 31 00:20:27.369700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.369690    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 31 00:20:27.375592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.375569    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 31 00:20:27.414608 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.414581    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.414714 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.414613    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrbf\" (UniqueName: \"kubernetes.io/projected/ec65f409-de5e-4290-99ed-fa7cb21f56da-kube-api-access-sxrbf\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.414714 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.414641    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec65f409-de5e-4290-99ed-fa7cb21f56da-tmp\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.414714 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.414700    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.414830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.414783    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec65f409-de5e-4290-99ed-fa7cb21f56da-manifests\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.414874 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.414831    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-metrics-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.474187 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.474127    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"]
Oct 31 00:20:27.515280 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515253    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec65f409-de5e-4290-99ed-fa7cb21f56da-manifests\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.515447 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515321    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-metrics-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.515447 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515395    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.515447 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515443    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrbf\" (UniqueName: \"kubernetes.io/projected/ec65f409-de5e-4290-99ed-fa7cb21f56da-kube-api-access-sxrbf\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.515629 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515480    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec65f409-de5e-4290-99ed-fa7cb21f56da-tmp\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.515629 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515509    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.515731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.515660    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ec65f409-de5e-4290-99ed-fa7cb21f56da-manifests\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.517707 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.517680    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec65f409-de5e-4290-99ed-fa7cb21f56da-tmp\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.517933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.517914    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-metrics-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.517975 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.517931    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.518082 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.518061    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ec65f409-de5e-4290-99ed-fa7cb21f56da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.574671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.574644    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrbf\" (UniqueName: \"kubernetes.io/projected/ec65f409-de5e-4290-99ed-fa7cb21f56da-kube-api-access-sxrbf\") pod \"opendatahub-operator-controller-manager-7fbb8789b-9lnxp\" (UID: \"ec65f409-de5e-4290-99ed-fa7cb21f56da\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.615887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.615857    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:27.916776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.916747    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88"
Oct 31 00:20:27.917223 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.916776    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7z8r88" event={"ID":"ddb29249-4c18-4f7b-8db8-9d3030d653b6","Type":"ContainerDied","Data":"8831f2ec6b7a5ad624b62735656e48d0bd5992db46ef86dd15505c60cb5625bd"}
Oct 31 00:20:27.917223 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.916840    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8831f2ec6b7a5ad624b62735656e48d0bd5992db46ef86dd15505c60cb5625bd"
Oct 31 00:20:27.919111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.919090    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn"
Oct 31 00:20:27.919246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.919112    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847abblxn" event={"ID":"03ad8d9e-18bf-473b-afd7-4dc5107883a1","Type":"ContainerDied","Data":"e8970581f3ccf5a68b681db2d0ac4069c7504281d1d72f029d5ca27f42dc6a47"}
Oct 31 00:20:27.919246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.919156    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8970581f3ccf5a68b681db2d0ac4069c7504281d1d72f029d5ca27f42dc6a47"
Oct 31 00:20:27.921385 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.921361    5925 generic.go:356] "Generic (PLEG): container finished" podID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerID="4c66a51d5d4fe88e6ca47ac5dd62c9a66dcfa84880433067a7e2aded7b5091eb" exitCode=0
Oct 31 00:20:27.921525 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:27.921480    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" event={"ID":"45cb720a-5107-4a44-b1b4-e8205998ed3d","Type":"ContainerDied","Data":"4c66a51d5d4fe88e6ca47ac5dd62c9a66dcfa84880433067a7e2aded7b5091eb"}
Oct 31 00:20:28.067250 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.067216    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:20:28.119787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.119724    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs\" (UniqueName: \"kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs\") pod \"31b86c55-f117-425f-abbc-a6473e496162\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") "
Oct 31 00:20:28.119927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.119813    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util\") pod \"31b86c55-f117-425f-abbc-a6473e496162\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") "
Oct 31 00:20:28.119927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.119878    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle\") pod \"31b86c55-f117-425f-abbc-a6473e496162\" (UID: \"31b86c55-f117-425f-abbc-a6473e496162\") "
Oct 31 00:20:28.120245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.120212    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle" pod "31b86c55-f117-425f-abbc-a6473e496162" (UID: "31b86c55-f117-425f-abbc-a6473e496162"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:28.121774 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.121754    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs" pod "31b86c55-f117-425f-abbc-a6473e496162" (UID: "31b86c55-f117-425f-abbc-a6473e496162"). InnerVolumeSpecName "kube-api-access-c9brs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:28.124655 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.124630    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util" pod "31b86c55-f117-425f-abbc-a6473e496162" (UID: "31b86c55-f117-425f-abbc-a6473e496162"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:28.220715 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.220683    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:28.220715 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.220713    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/31b86c55-f117-425f-abbc-a6473e496162-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:28.220876 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.220723    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9brs\" (UniqueName: \"kubernetes.io/projected/31b86c55-f117-425f-abbc-a6473e496162-kube-api-access-c9brs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:28.407174 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.407139    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"]
Oct 31 00:20:28.434531 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:20:28.434497    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec65f409_de5e_4290_99ed_fa7cb21f56da.slice/crio-2e723996ad93c839d54dd54a6734f200ab6bea05a9c1aa8356fee4df86e93724 WatchSource:0}: Error finding container 2e723996ad93c839d54dd54a6734f200ab6bea05a9c1aa8356fee4df86e93724: Status 404 returned error can't find the container with id 2e723996ad93c839d54dd54a6734f200ab6bea05a9c1aa8356fee4df86e93724
Oct 31 00:20:28.927635 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.927603    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht" event={"ID":"31b86c55-f117-425f-abbc-a6473e496162","Type":"ContainerDied","Data":"e9c7b368a78acfb75b25405daabc4096aa2fe51cfcef776f844a3cff101b9e59"}
Oct 31 00:20:28.928047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.927658    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9c7b368a78acfb75b25405daabc4096aa2fe51cfcef776f844a3cff101b9e59"
Oct 31 00:20:28.928047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.927611    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6448k4ht"
Oct 31 00:20:28.929092 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:28.929064    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp" event={"ID":"ec65f409-de5e-4290-99ed-fa7cb21f56da","Type":"ContainerStarted","Data":"2e723996ad93c839d54dd54a6734f200ab6bea05a9c1aa8356fee4df86e93724"}
Oct 31 00:20:29.071505 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.071479    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:20:29.128798 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.128768    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle\") pod \"45cb720a-5107-4a44-b1b4-e8205998ed3d\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") "
Oct 31 00:20:29.128940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.128885    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq\" (UniqueName: \"kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq\") pod \"45cb720a-5107-4a44-b1b4-e8205998ed3d\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") "
Oct 31 00:20:29.128940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.128925    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util\") pod \"45cb720a-5107-4a44-b1b4-e8205998ed3d\" (UID: \"45cb720a-5107-4a44-b1b4-e8205998ed3d\") "
Oct 31 00:20:29.129485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.129463    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle" pod "45cb720a-5107-4a44-b1b4-e8205998ed3d" (UID: "45cb720a-5107-4a44-b1b4-e8205998ed3d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:29.131070 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.131045    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq" pod "45cb720a-5107-4a44-b1b4-e8205998ed3d" (UID: "45cb720a-5107-4a44-b1b4-e8205998ed3d"). InnerVolumeSpecName "kube-api-access-ltxgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:20:29.134067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.134043    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util" pod "45cb720a-5107-4a44-b1b4-e8205998ed3d" (UID: "45cb720a-5107-4a44-b1b4-e8205998ed3d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:20:29.230026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.229963    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltxgq\" (UniqueName: \"kubernetes.io/projected/45cb720a-5107-4a44-b1b4-e8205998ed3d-kube-api-access-ltxgq\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:29.230026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.229988    5925 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-util\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:29.230026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.229997    5925 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/45cb720a-5107-4a44-b1b4-e8205998ed3d-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:20:29.936130 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.936097    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2"
Oct 31 00:20:29.936666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.936097    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c9z8c2" event={"ID":"45cb720a-5107-4a44-b1b4-e8205998ed3d","Type":"ContainerDied","Data":"cbeafd6e14358684bad6727e56f3ee6981ba843e9caa154b06dcf8461607d327"}
Oct 31 00:20:29.936666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:29.936232    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbeafd6e14358684bad6727e56f3ee6981ba843e9caa154b06dcf8461607d327"
Oct 31 00:20:32.953696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:32.953657    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp" event={"ID":"ec65f409-de5e-4290-99ed-fa7cb21f56da","Type":"ContainerStarted","Data":"c3b616520fa86421dd5f3c7bd249325c6d7e2854e807b522629af635dd82679f"}
Oct 31 00:20:33.959703 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:33.959668    5925 generic.go:356] "Generic (PLEG): container finished" podID="ec65f409-de5e-4290-99ed-fa7cb21f56da" containerID="c3b616520fa86421dd5f3c7bd249325c6d7e2854e807b522629af635dd82679f" exitCode=0
Oct 31 00:20:33.960127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:33.959717    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp" event={"ID":"ec65f409-de5e-4290-99ed-fa7cb21f56da","Type":"ContainerDied","Data":"c3b616520fa86421dd5f3c7bd249325c6d7e2854e807b522629af635dd82679f"}
Oct 31 00:20:34.971821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:34.971779    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp" event={"ID":"ec65f409-de5e-4290-99ed-fa7cb21f56da","Type":"ContainerStarted","Data":"33dc44dc7ad48ddeeca4c8ef0df800e7ff2eefff41c3968191de84e22a04f21f"}
Oct 31 00:20:34.972164 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:34.971942    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:35.141573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:35.141521    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp" podStartSLOduration=2.750541648 podStartE2EDuration="8.141508304s" totalImagesPullingTime="4.948832718s" totalInitContainerRuntime="442.133938ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:20:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:35.14029631 +0000 UTC m=+336.829176256" watchObservedRunningTime="2026-10-31 00:20:35.141508304 +0000 UTC m=+336.830388244"
Oct 31 00:20:43.680093 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680061    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"]
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680355    5925 cpu_manager.go:414] "containerMap: removing container" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="pull"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680365    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="pull"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680381    5925 cpu_manager.go:414] "containerMap: removing container" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="util"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680387    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="util"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680398    5925 cpu_manager.go:414] "containerMap: removing container" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="extract"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680402    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="extract"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680434    5925 cpu_manager.go:414] "containerMap: removing container" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="util"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680442    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="util"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680453    5925 cpu_manager.go:414] "containerMap: removing container" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="pull"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680458    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="pull"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680468    5925 cpu_manager.go:414] "containerMap: removing container" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="extract"
Oct 31 00:20:43.680493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680472    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="extract"
Oct 31 00:20:43.680853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680521    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="45cb720a-5107-4a44-b1b4-e8205998ed3d" containerName="extract"
Oct 31 00:20:43.680853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.680532    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="31b86c55-f117-425f-abbc-a6473e496162" containerName="extract"
Oct 31 00:20:43.683600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.683582    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.733950 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.733925    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 00:20:43.743217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.743190    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5rl\" (UniqueName: \"kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl\") pod \"kuadrant-operator-controller-manager-cf8469d7b-5sv2f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.743325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.743266    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-5sv2f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.781233 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.781210    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-42vz9\""
Oct 31 00:20:43.782666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.782649    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"]
Oct 31 00:20:43.833979 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.833957    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 00:20:43.844317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.844285    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-5sv2f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.844440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.844342    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5rl\" (UniqueName: \"kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl\") pod \"kuadrant-operator-controller-manager-cf8469d7b-5sv2f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.844675 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.844656    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-5sv2f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.903056 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.903029    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5rl\" (UniqueName: \"kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl\") pod \"kuadrant-operator-controller-manager-cf8469d7b-5sv2f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:43.995011 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:43.994954    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:44.468282 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:44.468254    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"]
Oct 31 00:20:44.513632 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:20:44.513606    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff140c9_b34b_460b_8fdb_7840a45c880f.slice/crio-359236aca6fa196995d1876f02bff3df916190b82f1c470ed14c51a2fbd27f7d WatchSource:0}: Error finding container 359236aca6fa196995d1876f02bff3df916190b82f1c470ed14c51a2fbd27f7d: Status 404 returned error can't find the container with id 359236aca6fa196995d1876f02bff3df916190b82f1c470ed14c51a2fbd27f7d
Oct 31 00:20:45.018229 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:45.018192    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f" event={"ID":"7ff140c9-b34b-460b-8fdb-7840a45c880f","Type":"ContainerStarted","Data":"359236aca6fa196995d1876f02bff3df916190b82f1c470ed14c51a2fbd27f7d"}
Oct 31 00:20:45.980172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:45.980143    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-7fbb8789b-9lnxp"
Oct 31 00:20:46.544475 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:20:46.544437    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:20:47.753921 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:47.753879    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"]
Oct 31 00:20:47.762388 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:47.762364    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:20:47.862843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:47.862796    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9jwcg\""
Oct 31 00:20:47.864312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:47.864288    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"]
Oct 31 00:20:47.877183 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:47.877157    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg2sp\" (UniqueName: \"kubernetes.io/projected/64678e6d-a55f-462b-a711-b0cd37bde52f-kube-api-access-kg2sp\") pod \"limitador-operator-controller-manager-5778bb4449-n5zkn\" (UID: \"64678e6d-a55f-462b-a711-b0cd37bde52f\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:20:47.978567 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:47.978530    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg2sp\" (UniqueName: \"kubernetes.io/projected/64678e6d-a55f-462b-a711-b0cd37bde52f-kube-api-access-kg2sp\") pod \"limitador-operator-controller-manager-5778bb4449-n5zkn\" (UID: \"64678e6d-a55f-462b-a711-b0cd37bde52f\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:20:48.038144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:48.038068    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg2sp\" (UniqueName: \"kubernetes.io/projected/64678e6d-a55f-462b-a711-b0cd37bde52f-kube-api-access-kg2sp\") pod \"limitador-operator-controller-manager-5778bb4449-n5zkn\" (UID: \"64678e6d-a55f-462b-a711-b0cd37bde52f\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:20:48.077575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:48.077544    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:20:48.463907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:48.463873    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"]
Oct 31 00:20:48.470724 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:20:48.470691    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64678e6d_a55f_462b_a711_b0cd37bde52f.slice/crio-4bf9394ffcf8fac84ca81e9c055104ab8cd46d7de619c1c26c84671e28f4c8f4 WatchSource:0}: Error finding container 4bf9394ffcf8fac84ca81e9c055104ab8cd46d7de619c1c26c84671e28f4c8f4: Status 404 returned error can't find the container with id 4bf9394ffcf8fac84ca81e9c055104ab8cd46d7de619c1c26c84671e28f4c8f4
Oct 31 00:20:49.038749 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:49.038711    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn" event={"ID":"64678e6d-a55f-462b-a711-b0cd37bde52f","Type":"ContainerStarted","Data":"4bf9394ffcf8fac84ca81e9c055104ab8cd46d7de619c1c26c84671e28f4c8f4"}
Oct 31 00:20:51.051125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:51.051085    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f" event={"ID":"7ff140c9-b34b-460b-8fdb-7840a45c880f","Type":"ContainerStarted","Data":"8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac"}
Oct 31 00:20:51.051504 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:51.051285    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:20:51.277630 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:51.277527    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f" podStartSLOduration=1.847710781 podStartE2EDuration="8.277511843s" totalImagesPullingTime="6.429801062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:51.228362217 +0000 UTC m=+352.917242189" watchObservedRunningTime="2026-10-31 00:20:51.277511843 +0000 UTC m=+352.966391791"
Oct 31 00:20:52.057484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.057449    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn" event={"ID":"64678e6d-a55f-462b-a711-b0cd37bde52f","Type":"ContainerStarted","Data":"22256d0aab98f264afe523386cab88ced565883a32045397eb9e4b0287f8ecd3"}
Oct 31 00:20:52.057837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.057573    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:20:52.213668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.213567    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn" podStartSLOduration=1.722109783 podStartE2EDuration="5.213555449s" totalImagesPullingTime="3.491445666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:52.211978539 +0000 UTC m=+353.900858486" watchObservedRunningTime="2026-10-31 00:20:52.213555449 +0000 UTC m=+353.902435394"
Oct 31 00:20:52.781299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.781263    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"]
Oct 31 00:20:52.784807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.784783    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:20:52.835359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.835334    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m7k6g\""
Oct 31 00:20:52.886725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.886692    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"]
Oct 31 00:20:52.915686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:52.915655    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ghn\" (UniqueName: \"kubernetes.io/projected/a1dae338-b202-45cc-9d47-e1d5df260ec2-kube-api-access-g9ghn\") pod \"authorino-operator-7b7bb4bc77-c6s66\" (UID: \"a1dae338-b202-45cc-9d47-e1d5df260ec2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:20:53.017048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:53.017010    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ghn\" (UniqueName: \"kubernetes.io/projected/a1dae338-b202-45cc-9d47-e1d5df260ec2-kube-api-access-g9ghn\") pod \"authorino-operator-7b7bb4bc77-c6s66\" (UID: \"a1dae338-b202-45cc-9d47-e1d5df260ec2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:20:53.079724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:53.079643    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ghn\" (UniqueName: \"kubernetes.io/projected/a1dae338-b202-45cc-9d47-e1d5df260ec2-kube-api-access-g9ghn\") pod \"authorino-operator-7b7bb4bc77-c6s66\" (UID: \"a1dae338-b202-45cc-9d47-e1d5df260ec2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:20:53.097508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:53.097478    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:20:53.490125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:53.490087    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"]
Oct 31 00:20:53.497289 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:20:53.497257    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dae338_b202_45cc_9d47_e1d5df260ec2.slice/crio-81e73ccfa6a8e0f8894937122fd658d44797bea32be584491cb8da016958afc8 WatchSource:0}: Error finding container 81e73ccfa6a8e0f8894937122fd658d44797bea32be584491cb8da016958afc8: Status 404 returned error can't find the container with id 81e73ccfa6a8e0f8894937122fd658d44797bea32be584491cb8da016958afc8
Oct 31 00:20:54.067607 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.067569    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66" event={"ID":"a1dae338-b202-45cc-9d47-e1d5df260ec2","Type":"ContainerStarted","Data":"81e73ccfa6a8e0f8894937122fd658d44797bea32be584491cb8da016958afc8"}
Oct 31 00:20:54.310421 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.310377    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"]
Oct 31 00:20:54.314965 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.314945    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.358212 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.358186    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"]
Oct 31 00:20:54.365821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.365802    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:20:54.404472 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.404445    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 31 00:20:54.404472 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.404465    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-56wdt\""
Oct 31 00:20:54.430941 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.430912    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5749590-155c-44ba-be43-270d8820bc46-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq\" (UID: \"f5749590-155c-44ba-be43-270d8820bc46\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.431049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.430954    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmc27\" (UniqueName: \"kubernetes.io/projected/f5749590-155c-44ba-be43-270d8820bc46-kube-api-access-kmc27\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq\" (UID: \"f5749590-155c-44ba-be43-270d8820bc46\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.531693 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.531652    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5749590-155c-44ba-be43-270d8820bc46-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq\" (UID: \"f5749590-155c-44ba-be43-270d8820bc46\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.531899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.531714    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmc27\" (UniqueName: \"kubernetes.io/projected/f5749590-155c-44ba-be43-270d8820bc46-kube-api-access-kmc27\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq\" (UID: \"f5749590-155c-44ba-be43-270d8820bc46\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.532044 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.532023    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5749590-155c-44ba-be43-270d8820bc46-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq\" (UID: \"f5749590-155c-44ba-be43-270d8820bc46\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.590474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.590452    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmc27\" (UniqueName: \"kubernetes.io/projected/f5749590-155c-44ba-be43-270d8820bc46-kube-api-access-kmc27\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq\" (UID: \"f5749590-155c-44ba-be43-270d8820bc46\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:54.627061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:54.627035    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"
Oct 31 00:20:55.054201 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:55.054123    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq"]
Oct 31 00:20:55.061658 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:20:55.061631    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5749590_155c_44ba_be43_270d8820bc46.slice/crio-a16578e52145f493be27e37409b68cd6b94b4df51493fcca4ca13593d7375a3c WatchSource:0}: Error finding container a16578e52145f493be27e37409b68cd6b94b4df51493fcca4ca13593d7375a3c: Status 404 returned error can't find the container with id a16578e52145f493be27e37409b68cd6b94b4df51493fcca4ca13593d7375a3c
Oct 31 00:20:55.072845 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:55.072820    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq" event={"ID":"f5749590-155c-44ba-be43-270d8820bc46","Type":"ContainerStarted","Data":"a16578e52145f493be27e37409b68cd6b94b4df51493fcca4ca13593d7375a3c"}
Oct 31 00:20:56.997965 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:56.997933    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"]
Oct 31 00:20:57.001152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.001131    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:20:57.053938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.053889    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 31 00:20:57.053938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.053923    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7cgtp\""
Oct 31 00:20:57.084810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.084774    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66" event={"ID":"a1dae338-b202-45cc-9d47-e1d5df260ec2","Type":"ContainerStarted","Data":"bf18d9b26097ba7703b29d1a32ae6c897a6494e1b5feee4168b46207885d0454"}
Oct 31 00:20:57.085057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.084915    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:20:57.103134 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.103104    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"]
Oct 31 00:20:57.153325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.153293    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frrk\" (UniqueName: \"kubernetes.io/projected/c5441a7e-9026-4b36-9919-f3237533a88d-kube-api-access-7frrk\") pod \"dns-operator-controller-manager-8557cbdb84-g767d\" (UID: \"c5441a7e-9026-4b36-9919-f3237533a88d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:20:57.236215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.236153    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66" podStartSLOduration=2.327007487 podStartE2EDuration="5.236135864s" totalImagesPullingTime="2.909128377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:57.234779791 +0000 UTC m=+358.923659738" watchObservedRunningTime="2026-10-31 00:20:57.236135864 +0000 UTC m=+358.925015810"
Oct 31 00:20:57.254038 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.253940    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frrk\" (UniqueName: \"kubernetes.io/projected/c5441a7e-9026-4b36-9919-f3237533a88d-kube-api-access-7frrk\") pod \"dns-operator-controller-manager-8557cbdb84-g767d\" (UID: \"c5441a7e-9026-4b36-9919-f3237533a88d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:20:57.313901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.313864    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frrk\" (UniqueName: \"kubernetes.io/projected/c5441a7e-9026-4b36-9919-f3237533a88d-kube-api-access-7frrk\") pod \"dns-operator-controller-manager-8557cbdb84-g767d\" (UID: \"c5441a7e-9026-4b36-9919-f3237533a88d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:20:57.315501 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.315481    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:20:57.753230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:57.753187    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"]
Oct 31 00:20:57.761649 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:20:57.761620    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5441a7e_9026_4b36_9919_f3237533a88d.slice/crio-dfdc97d1c805b5d20edb50db24431841aa52dd1f2342946211120857b152b227 WatchSource:0}: Error finding container dfdc97d1c805b5d20edb50db24431841aa52dd1f2342946211120857b152b227: Status 404 returned error can't find the container with id dfdc97d1c805b5d20edb50db24431841aa52dd1f2342946211120857b152b227
Oct 31 00:20:58.092300 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:58.092259    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d" event={"ID":"c5441a7e-9026-4b36-9919-f3237533a88d","Type":"ContainerStarted","Data":"dfdc97d1c805b5d20edb50db24431841aa52dd1f2342946211120857b152b227"}
Oct 31 00:20:58.094658 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:58.094628    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq" event={"ID":"f5749590-155c-44ba-be43-270d8820bc46","Type":"ContainerStarted","Data":"62dbe1638d80674898574b0f47e7ed480f046c3f86e5043532cb74be2d1b29e8"}
Oct 31 00:20:58.216819 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:20:58.216761    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-ntwmq" podStartSLOduration=1.300044908 podStartE2EDuration="4.21674714s" totalImagesPullingTime="2.916702232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:20:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:20:58.214489356 +0000 UTC m=+359.903369301" watchObservedRunningTime="2026-10-31 00:20:58.21674714 +0000 UTC m=+359.905627086"
Oct 31 00:21:00.941530 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:00.941500    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 31 00:21:01.111833 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:01.111801    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d" event={"ID":"c5441a7e-9026-4b36-9919-f3237533a88d","Type":"ContainerStarted","Data":"95db91e3b4e9079e83e71b917ea4e72c7b7eb0ff47d99b81417c314f9b5f8696"}
Oct 31 00:21:01.112020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:01.111900    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:21:01.226467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:01.226370    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d" podStartSLOduration=2.099796339 podStartE2EDuration="5.226355424s" totalImagesPullingTime="3.126559085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:01.224709818 +0000 UTC m=+362.913589764" watchObservedRunningTime="2026-10-31 00:21:01.226355424 +0000 UTC m=+362.915235370"
Oct 31 00:21:02.060095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.060062    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:21:02.599504 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.599468    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"]
Oct 31 00:21:02.603059 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.603037    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.697028 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.696986    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7csg\" (UniqueName: \"kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg\") pod \"kuadrant-operator-controller-manager-678d87766f-s46bl\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.697191 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.697054    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-s46bl\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.723169 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.723139    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"]
Oct 31 00:21:02.798138 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.798103    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-s46bl\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.798303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.798187    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7csg\" (UniqueName: \"kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg\") pod \"kuadrant-operator-controller-manager-678d87766f-s46bl\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.798509 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.798488    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-s46bl\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.863740 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.863675    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7csg\" (UniqueName: \"kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg\") pod \"kuadrant-operator-controller-manager-678d87766f-s46bl\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:02.915824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:02.915791    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:03.064566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:03.064536    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-n5zkn"
Oct 31 00:21:03.352935 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:03.352904    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"]
Oct 31 00:21:03.360158 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:21:03.360127    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b55dc35_f3e5_4905_9c0f_0925f4d63785.slice/crio-32fa83576d8e0a36d1308601ee6ddf61f4cb8b51fa83e852ef8cae524d56fa18 WatchSource:0}: Error finding container 32fa83576d8e0a36d1308601ee6ddf61f4cb8b51fa83e852ef8cae524d56fa18: Status 404 returned error can't find the container with id 32fa83576d8e0a36d1308601ee6ddf61f4cb8b51fa83e852ef8cae524d56fa18
Oct 31 00:21:04.128198 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:04.128160    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl" event={"ID":"4b55dc35-f3e5-4905-9c0f-0925f4d63785","Type":"ContainerStarted","Data":"94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357"}
Oct 31 00:21:04.128598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:04.128213    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl" event={"ID":"4b55dc35-f3e5-4905-9c0f-0925f4d63785","Type":"ContainerStarted","Data":"32fa83576d8e0a36d1308601ee6ddf61f4cb8b51fa83e852ef8cae524d56fa18"}
Oct 31 00:21:04.128598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:04.128269    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:04.301554 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:04.301499    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl" podStartSLOduration=2.30148722 podStartE2EDuration="2.30148722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:04.301094088 +0000 UTC m=+365.989974034" watchObservedRunningTime="2026-10-31 00:21:04.30148722 +0000 UTC m=+365.990367167"
Oct 31 00:21:06.615514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.615441    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"]
Oct 31 00:21:06.617867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.617846    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.676504 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.676455    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6kxg6\""
Oct 31 00:21:06.721894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.721856    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"]
Oct 31 00:21:06.728932 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.728901    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.728932 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.728935    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729007    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729032    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729057    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28mvg\" (UniqueName: \"kubernetes.io/projected/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-kube-api-access-28mvg\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729130    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729344 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729158    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729344 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729238    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.729344 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.729287    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830181    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830245    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830359    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830531 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830407    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830531 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830454    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830531 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830493    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28mvg\" (UniqueName: \"kubernetes.io/projected/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-kube-api-access-28mvg\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830676    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830753 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830724    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830804    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.830882 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830863    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.831077 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.830998    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.831077 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.831065    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.831215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.831096    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.831363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.831339    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.833399 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.833377    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.833399 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.833391    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.890507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.890447    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.895136 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.895112    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28mvg\" (UniqueName: \"kubernetes.io/projected/0a24fae2-5878-4ea9-8a51-1ecb6685fd76-kube-api-access-28mvg\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6\" (UID: \"0a24fae2-5878-4ea9-8a51-1ecb6685fd76\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:06.929973 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:06.929947    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:07.354750 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:07.354709    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"]
Oct 31 00:21:07.361094 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:21:07.361062    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a24fae2_5878_4ea9_8a51_1ecb6685fd76.slice/crio-6dd051ce8119dec22e8aeaff97aa1aad171f2ab875a291faa4297f288e41b9b1 WatchSource:0}: Error finding container 6dd051ce8119dec22e8aeaff97aa1aad171f2ab875a291faa4297f288e41b9b1: Status 404 returned error can't find the container with id 6dd051ce8119dec22e8aeaff97aa1aad171f2ab875a291faa4297f288e41b9b1
Oct 31 00:21:07.363182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:07.363152    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:21:07.363251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:07.363218    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:21:07.363291 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:07.363251    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:21:08.096689 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:08.096658    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-c6s66"
Oct 31 00:21:08.149160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:08.149126    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6" event={"ID":"0a24fae2-5878-4ea9-8a51-1ecb6685fd76","Type":"ContainerStarted","Data":"0cc4fa9716785c45dea29f3a5cfa44a46628d7d72b3fdba998b5074e5cc592ea"}
Oct 31 00:21:08.149329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:08.149183    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6" event={"ID":"0a24fae2-5878-4ea9-8a51-1ecb6685fd76","Type":"ContainerStarted","Data":"6dd051ce8119dec22e8aeaff97aa1aad171f2ab875a291faa4297f288e41b9b1"}
Oct 31 00:21:08.346404 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:08.346346    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6" podStartSLOduration=2.346333108 podStartE2EDuration="2.346333108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:08.344855311 +0000 UTC m=+370.033735257" watchObservedRunningTime="2026-10-31 00:21:08.346333108 +0000 UTC m=+370.035213053"
Oct 31 00:21:08.930556 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:08.930517    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:08.935131 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:08.935107    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:09.153883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:09.153851    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:09.154909 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:09.154892    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6"
Oct 31 00:21:11.462297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.462263    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-fjjv4"]
Oct 31 00:21:11.465162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.465142    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.515249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.515225    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 31 00:21:11.562845 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.562822    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 31 00:21:11.562845 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.562825    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-grqxk\""
Oct 31 00:21:11.564473 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.564454    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-fjjv4"]
Oct 31 00:21:11.570175 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.570156    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed9d9536-d1ca-4f03-9cd2-da78d642a23f-bound-sa-token\") pod \"cert-manager-597b95cb84-fjjv4\" (UID: \"ed9d9536-d1ca-4f03-9cd2-da78d642a23f\") " pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.570245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.570184    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjw5\" (UniqueName: \"kubernetes.io/projected/ed9d9536-d1ca-4f03-9cd2-da78d642a23f-kube-api-access-5jjw5\") pod \"cert-manager-597b95cb84-fjjv4\" (UID: \"ed9d9536-d1ca-4f03-9cd2-da78d642a23f\") " pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.671150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.671114    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed9d9536-d1ca-4f03-9cd2-da78d642a23f-bound-sa-token\") pod \"cert-manager-597b95cb84-fjjv4\" (UID: \"ed9d9536-d1ca-4f03-9cd2-da78d642a23f\") " pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.671150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.671152    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjw5\" (UniqueName: \"kubernetes.io/projected/ed9d9536-d1ca-4f03-9cd2-da78d642a23f-kube-api-access-5jjw5\") pod \"cert-manager-597b95cb84-fjjv4\" (UID: \"ed9d9536-d1ca-4f03-9cd2-da78d642a23f\") " pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.731164 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.731100    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed9d9536-d1ca-4f03-9cd2-da78d642a23f-bound-sa-token\") pod \"cert-manager-597b95cb84-fjjv4\" (UID: \"ed9d9536-d1ca-4f03-9cd2-da78d642a23f\") " pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.731466 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.731445    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjw5\" (UniqueName: \"kubernetes.io/projected/ed9d9536-d1ca-4f03-9cd2-da78d642a23f-kube-api-access-5jjw5\") pod \"cert-manager-597b95cb84-fjjv4\" (UID: \"ed9d9536-d1ca-4f03-9cd2-da78d642a23f\") " pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:11.793352 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:11.793320    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-fjjv4"
Oct 31 00:21:12.118761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:12.118729    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g767d"
Oct 31 00:21:12.162693 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:12.162666    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-fjjv4"]
Oct 31 00:21:12.170168 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:21:12.170141    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded9d9536_d1ca_4f03_9cd2_da78d642a23f.slice/crio-835b9a046789cb97788617c59dccf0b5df7bdd2d62e09a98024679315a2c511e WatchSource:0}: Error finding container 835b9a046789cb97788617c59dccf0b5df7bdd2d62e09a98024679315a2c511e: Status 404 returned error can't find the container with id 835b9a046789cb97788617c59dccf0b5df7bdd2d62e09a98024679315a2c511e
Oct 31 00:21:13.173062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:13.173029    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-fjjv4" event={"ID":"ed9d9536-d1ca-4f03-9cd2-da78d642a23f","Type":"ContainerStarted","Data":"835b9a046789cb97788617c59dccf0b5df7bdd2d62e09a98024679315a2c511e"}
Oct 31 00:21:15.136086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:15.136056    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 00:21:15.358777 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:15.358741    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"]
Oct 31 00:21:15.359001 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:15.358974    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f" podUID="7ff140c9-b34b-460b-8fdb-7840a45c880f" containerName="manager" containerID="cri-o://8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac" gracePeriod=10
Oct 31 00:21:16.192202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:16.192157    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-fjjv4" event={"ID":"ed9d9536-d1ca-4f03-9cd2-da78d642a23f","Type":"ContainerStarted","Data":"c43d0d97c53c24eaa4c1b712599bc8f0810f8b057b8783d06411f6836ffeabf7"}
Oct 31 00:21:16.392120 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:16.392068    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-fjjv4" podStartSLOduration=1.745130959 podStartE2EDuration="5.392055756s" totalImagesPullingTime="3.646924797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:16.391317543 +0000 UTC m=+378.080197501" watchObservedRunningTime="2026-10-31 00:21:16.392055756 +0000 UTC m=+378.080935702"
Oct 31 00:21:16.543312 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:21:16.543230    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:21:17.102373 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.102336    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8fsq6"]
Oct 31 00:21:17.105540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.104871    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:17.113512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.113492    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wd2\" (UniqueName: \"kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2\") pod \"authorino-57f7f8659f-8fsq6\" (UID: \"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef\") " pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:17.155946 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.155925    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fst7h\""
Oct 31 00:21:17.204360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.204330    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8fsq6"]
Oct 31 00:21:17.214180 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.214159    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wd2\" (UniqueName: \"kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2\") pod \"authorino-57f7f8659f-8fsq6\" (UID: \"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef\") " pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:17.272785 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.272754    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wd2\" (UniqueName: \"kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2\") pod \"authorino-57f7f8659f-8fsq6\" (UID: \"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef\") " pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:17.415576 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.415501    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:17.784647 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.784562    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8fsq6"]
Oct 31 00:21:17.791925 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:21:17.791889    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3963e86_b5fe_4a8e_b576_c3fe4b1f24ef.slice/crio-8ba2d35947f5fb3a854992c7a69c10139b0e08a287956abc8d40f5c7695a9a10 WatchSource:0}: Error finding container 8ba2d35947f5fb3a854992c7a69c10139b0e08a287956abc8d40f5c7695a9a10: Status 404 returned error can't find the container with id 8ba2d35947f5fb3a854992c7a69c10139b0e08a287956abc8d40f5c7695a9a10
Oct 31 00:21:17.993076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:17.993050    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:21:18.018791 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.018760    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl\" (UniqueName: \"kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl\") pod \"7ff140c9-b34b-460b-8fdb-7840a45c880f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") "
Oct 31 00:21:18.018913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.018830    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume\") pod \"7ff140c9-b34b-460b-8fdb-7840a45c880f\" (UID: \"7ff140c9-b34b-460b-8fdb-7840a45c880f\") "
Oct 31 00:21:18.019185 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.019152    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume" pod "7ff140c9-b34b-460b-8fdb-7840a45c880f" (UID: "7ff140c9-b34b-460b-8fdb-7840a45c880f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:21:18.020916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.020894    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl" pod "7ff140c9-b34b-460b-8fdb-7840a45c880f" (UID: "7ff140c9-b34b-460b-8fdb-7840a45c880f"). InnerVolumeSpecName "kube-api-access-8s5rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:21:18.119548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.119510    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s5rl\" (UniqueName: \"kubernetes.io/projected/7ff140c9-b34b-460b-8fdb-7840a45c880f-kube-api-access-8s5rl\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:21:18.119548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.119549    5925 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ff140c9-b34b-460b-8fdb-7840a45c880f-extensions-socket-volume\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:21:18.203497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.203454    5925 generic.go:356] "Generic (PLEG): container finished" podID="7ff140c9-b34b-460b-8fdb-7840a45c880f" containerID="8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac" exitCode=0
Oct 31 00:21:18.203676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.203504    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"
Oct 31 00:21:18.203676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.203546    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f" event={"ID":"7ff140c9-b34b-460b-8fdb-7840a45c880f","Type":"ContainerDied","Data":"8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac"}
Oct 31 00:21:18.203676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.203630    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f" event={"ID":"7ff140c9-b34b-460b-8fdb-7840a45c880f","Type":"ContainerDied","Data":"359236aca6fa196995d1876f02bff3df916190b82f1c470ed14c51a2fbd27f7d"}
Oct 31 00:21:18.203676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.203653    5925 scope.go:122] "RemoveContainer" containerID="8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac"
Oct 31 00:21:18.204861 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.204835    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8fsq6" event={"ID":"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef","Type":"ContainerStarted","Data":"8ba2d35947f5fb3a854992c7a69c10139b0e08a287956abc8d40f5c7695a9a10"}
Oct 31 00:21:18.212637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.212619    5925 scope.go:122] "RemoveContainer" containerID="8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac"
Oct 31 00:21:18.212899 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:21:18.212883    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac\": container with ID starting with 8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac not found: ID does not exist" containerID="8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac"
Oct 31 00:21:18.212948 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.212908    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac"} err="failed to get container status \"8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac\": rpc error: code = NotFound desc = could not find container \"8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac\": container with ID starting with 8494720a7b7bd92ad1914a93355503c289f3dbd00933e091a38004e8a05c6cac not found: ID does not exist"
Oct 31 00:21:18.361202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.361168    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"]
Oct 31 00:21:18.365378 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.365355    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-5sv2f"]
Oct 31 00:21:18.450423 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:18.450390    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ff140c9-b34b-460b-8fdb-7840a45c880f" path="/var/lib/kubelet/pods/7ff140c9-b34b-460b-8fdb-7840a45c880f/volumes"
Oct 31 00:21:22.228628 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:22.228588    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8fsq6" event={"ID":"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef","Type":"ContainerStarted","Data":"3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482"}
Oct 31 00:21:22.337247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:22.337202    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-8fsq6" podStartSLOduration=1.409423423 podStartE2EDuration="5.337188043s" totalImagesPullingTime="3.92776462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:22.33711649 +0000 UTC m=+384.025996436" watchObservedRunningTime="2026-10-31 00:21:22.337188043 +0000 UTC m=+384.026067986"
Oct 31 00:21:37.571671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.571631    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-6bhf9"]
Oct 31 00:21:37.572255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.572171    5925 cpu_manager.go:414] "containerMap: removing container" podUID="7ff140c9-b34b-460b-8fdb-7840a45c880f" containerName="manager"
Oct 31 00:21:37.572255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.572192    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ff140c9-b34b-460b-8fdb-7840a45c880f" containerName="manager"
Oct 31 00:21:37.572379 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.572299    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ff140c9-b34b-460b-8fdb-7840a45c880f" containerName="manager"
Oct 31 00:21:37.575587 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.575565    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:21:37.632233 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.632204    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-6bhf9"]
Oct 31 00:21:37.687466 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.687434    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxlfq\" (UniqueName: \"kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq\") pod \"authorino-56c6c9ddd5-6bhf9\" (UID: \"01da0bef-a80b-4175-9fb8-30115c94ae4c\") " pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:21:37.788188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.788152    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxlfq\" (UniqueName: \"kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq\") pod \"authorino-56c6c9ddd5-6bhf9\" (UID: \"01da0bef-a80b-4175-9fb8-30115c94ae4c\") " pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:21:37.847657 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.847621    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxlfq\" (UniqueName: \"kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq\") pod \"authorino-56c6c9ddd5-6bhf9\" (UID: \"01da0bef-a80b-4175-9fb8-30115c94ae4c\") " pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:21:37.887668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:37.887634    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:21:38.257673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:38.257594    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-6bhf9"]
Oct 31 00:21:38.264088 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:21:38.264059    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01da0bef_a80b_4175_9fb8_30115c94ae4c.slice/crio-1e85de25f7b58945f82705fa5bb21cc4067d839cb1b58868fa6ad37a2087e40a WatchSource:0}: Error finding container 1e85de25f7b58945f82705fa5bb21cc4067d839cb1b58868fa6ad37a2087e40a: Status 404 returned error can't find the container with id 1e85de25f7b58945f82705fa5bb21cc4067d839cb1b58868fa6ad37a2087e40a
Oct 31 00:21:38.307478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:38.307444    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9" event={"ID":"01da0bef-a80b-4175-9fb8-30115c94ae4c","Type":"ContainerStarted","Data":"1e85de25f7b58945f82705fa5bb21cc4067d839cb1b58868fa6ad37a2087e40a"}
Oct 31 00:21:40.318166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.318130    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9" event={"ID":"01da0bef-a80b-4175-9fb8-30115c94ae4c","Type":"ContainerStarted","Data":"1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9"}
Oct 31 00:21:40.427778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.427724    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9" podStartSLOduration=2.021283862 podStartE2EDuration="3.427710864s" totalImagesPullingTime="1.406427002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:21:40.42697231 +0000 UTC m=+402.115852257" watchObservedRunningTime="2026-10-31 00:21:40.427710864 +0000 UTC m=+402.116590810"
Oct 31 00:21:40.476217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.476180    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8fsq6"]
Oct 31 00:21:40.476409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.476383    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-8fsq6" podUID="c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" containerName="authorino" containerID="cri-o://3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482" gracePeriod=30
Oct 31 00:21:40.721036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.721009    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:40.814284 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.814254    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2\" (UniqueName: \"kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2\") pod \"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef\" (UID: \"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef\") "
Oct 31 00:21:40.816282 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.816256    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2" pod "c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" (UID: "c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef"). InnerVolumeSpecName "kube-api-access-22wd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:21:40.914918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:40.914834    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22wd2\" (UniqueName: \"kubernetes.io/projected/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef-kube-api-access-22wd2\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:21:41.323890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.323810    5925 generic.go:356] "Generic (PLEG): container finished" podID="c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" containerID="3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482" exitCode=0
Oct 31 00:21:41.323890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.323858    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8fsq6"
Oct 31 00:21:41.324354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.323891    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8fsq6" event={"ID":"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef","Type":"ContainerDied","Data":"3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482"}
Oct 31 00:21:41.324354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.323936    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8fsq6" event={"ID":"c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef","Type":"ContainerDied","Data":"8ba2d35947f5fb3a854992c7a69c10139b0e08a287956abc8d40f5c7695a9a10"}
Oct 31 00:21:41.324354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.323956    5925 scope.go:122] "RemoveContainer" containerID="3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482"
Oct 31 00:21:41.332618 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.332601    5925 scope.go:122] "RemoveContainer" containerID="3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482"
Oct 31 00:21:41.332874 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:21:41.332856    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482\": container with ID starting with 3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482 not found: ID does not exist" containerID="3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482"
Oct 31 00:21:41.332938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.332886    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482"} err="failed to get container status \"3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482\": rpc error: code = NotFound desc = could not find container \"3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482\": container with ID starting with 3291f18ef723c9a08ae02cd79e459a93a87da900d23540a94c25bc409a5d1482 not found: ID does not exist"
Oct 31 00:21:41.482319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.482281    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8fsq6"]
Oct 31 00:21:41.486451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:41.486427    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8fsq6"]
Oct 31 00:21:42.450853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:21:42.450821    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" path="/var/lib/kubelet/pods/c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef/volumes"
Oct 31 00:21:46.541598 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:21:46.541562    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:22:05.245392 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.245356    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-nkw25"]
Oct 31 00:22:05.251379 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.251330    5925 cpu_manager.go:414] "containerMap: removing container" podUID="c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" containerName="authorino"
Oct 31 00:22:05.251594 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.251408    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" containerName="authorino"
Oct 31 00:22:05.251778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.251751    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3963e86-b5fe-4a8e-b576-c3fe4b1f24ef" containerName="authorino"
Oct 31 00:22:05.254914 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.254896    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.305648 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.305621    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 00:22:05.305648 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.305636    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 31 00:22:05.353086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.353049    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 00:22:05.353086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.353058    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 00:22:05.353289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.353093    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 31 00:22:05.353289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.353067    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q6rb4\""
Oct 31 00:22:05.354928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.354904    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-nkw25"]
Oct 31 00:22:05.427068 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.427026    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.427068 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.427073    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx4xh\" (UniqueName: \"kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.427321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.427215    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.528328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.528245    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.528328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.528278    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx4xh\" (UniqueName: \"kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.528328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.528308    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.530782 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.530762    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.530870 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.530819    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.587113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.587076    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx4xh\" (UniqueName: \"kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh\") pod \"maas-controller-579cf7c6d-nkw25\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") " pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.684810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.684771    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d56c449c7-9kbkd"]
Oct 31 00:22:05.687743 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.687721    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.747512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.747475    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-9kbkd"]
Oct 31 00:22:05.831047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.830971    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7xvk\" (UniqueName: \"kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.831047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.831029    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.831227 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.831130    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.866128 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.866098    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:05.932377 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.932340    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.932547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.932382    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.932547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.932436    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xvk\" (UniqueName: \"kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.935541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.935515    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.935541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.935534    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:05.991043 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:05.991010    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xvk\" (UniqueName: \"kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk\") pod \"maas-controller-6d56c449c7-9kbkd\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") " pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:06.000047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:06.000023    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:06.237376 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:06.237338    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-nkw25"]
Oct 31 00:22:06.243767 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:06.243743    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734f88c1_ebbc_4d58_9d7b_fb8cc2ecb36f.slice/crio-20eab937c57c71462dd81c86da38241e368019882b837692bcf59490bd4691c0 WatchSource:0}: Error finding container 20eab937c57c71462dd81c86da38241e368019882b837692bcf59490bd4691c0: Status 404 returned error can't find the container with id 20eab937c57c71462dd81c86da38241e368019882b837692bcf59490bd4691c0
Oct 31 00:22:06.371989 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:06.371954    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-9kbkd"]
Oct 31 00:22:06.378895 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:06.378868    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0a7eda_d7cb_4931_b807_a9bc2693cb2c.slice/crio-a48dc2134dcf45537e76c58ce50fa4d72089411cbbda603486dfefdb7761c207 WatchSource:0}: Error finding container a48dc2134dcf45537e76c58ce50fa4d72089411cbbda603486dfefdb7761c207: Status 404 returned error can't find the container with id a48dc2134dcf45537e76c58ce50fa4d72089411cbbda603486dfefdb7761c207
Oct 31 00:22:06.450217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:06.450173    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-nkw25" event={"ID":"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f","Type":"ContainerStarted","Data":"20eab937c57c71462dd81c86da38241e368019882b837692bcf59490bd4691c0"}
Oct 31 00:22:06.450360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:06.450230    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" event={"ID":"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c","Type":"ContainerStarted","Data":"a48dc2134dcf45537e76c58ce50fa4d72089411cbbda603486dfefdb7761c207"}
Oct 31 00:22:10.468831 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:10.468788    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-nkw25" event={"ID":"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f","Type":"ContainerStarted","Data":"1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1"}
Oct 31 00:22:10.469345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:10.468867    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:10.470379 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:10.470346    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" event={"ID":"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c","Type":"ContainerStarted","Data":"876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"}
Oct 31 00:22:10.470500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:10.470405    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:10.586015 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:10.585963    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-nkw25" podStartSLOduration=1.9027994129999999 podStartE2EDuration="5.585951757s" totalImagesPullingTime="3.683152344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:22:10.584137432 +0000 UTC m=+432.273017378" watchObservedRunningTime="2026-10-31 00:22:10.585951757 +0000 UTC m=+432.274831702"
Oct 31 00:22:10.735630 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:10.735530    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" podStartSLOduration=2.145540959 podStartE2EDuration="5.735514884s" totalImagesPullingTime="3.589973925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:22:10.734447609 +0000 UTC m=+432.423327552" watchObservedRunningTime="2026-10-31 00:22:10.735514884 +0000 UTC m=+432.424394829"
Oct 31 00:22:13.210436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.210387    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"]
Oct 31 00:22:13.214211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.214190    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.264519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.264491    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 31 00:22:13.264673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.264551    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-hhnvm\""
Oct 31 00:22:13.294105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.294072    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.294273 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.294161    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.294273 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.294194    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbgv7\" (UniqueName: \"kubernetes.io/projected/8d52ab28-2c13-4f05-8a30-610e75869c18-kube-api-access-gbgv7\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.294273 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.294216    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d52ab28-2c13-4f05-8a30-610e75869c18-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.312052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.312008    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 31 00:22:13.312052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.312015    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 31 00:22:13.315055 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.315029    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"]
Oct 31 00:22:13.395381 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.395351    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.395578 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.395391    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbgv7\" (UniqueName: \"kubernetes.io/projected/8d52ab28-2c13-4f05-8a30-610e75869c18-kube-api-access-gbgv7\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.395578 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.395431    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d52ab28-2c13-4f05-8a30-610e75869c18-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.395578 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.395477    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.395578 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:13.395497    5925 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Oct 31 00:22:13.395578 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:13.395575    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-proxy-source podName:8d52ab28-2c13-4f05-8a30-610e75869c18 nodeName:}" failed. No retries permitted until 2026-10-31 00:22:13.895556601 +0000 UTC m=+435.584436547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-n99lx" (UID: "8d52ab28-2c13-4f05-8a30-610e75869c18") : configmap "usage-tenancy-proxy-source" not found
Oct 31 00:22:13.395770 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:13.395623    5925 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found
Oct 31 00:22:13.395770 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:13.395688    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d52ab28-2c13-4f05-8a30-610e75869c18-tls-cert podName:8d52ab28-2c13-4f05-8a30-610e75869c18 nodeName:}" failed. No retries permitted until 2026-10-31 00:22:13.895671195 +0000 UTC m=+435.584551142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/8d52ab28-2c13-4f05-8a30-610e75869c18-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-n99lx" (UID: "8d52ab28-2c13-4f05-8a30-610e75869c18") : secret "usage-logs-tenancy-proxy-tls" not found
Oct 31 00:22:13.396077 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.396060    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.454334 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.454298    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbgv7\" (UniqueName: \"kubernetes.io/projected/8d52ab28-2c13-4f05-8a30-610e75869c18-kube-api-access-gbgv7\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.899379 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.899345    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.899575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.899391    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d52ab28-2c13-4f05-8a30-610e75869c18-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.900392 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.900368    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/8d52ab28-2c13-4f05-8a30-610e75869c18-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:13.901742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:13.901723    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d52ab28-2c13-4f05-8a30-610e75869c18-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-n99lx\" (UID: \"8d52ab28-2c13-4f05-8a30-610e75869c18\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:14.126730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:14.126691    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:14.498848 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:14.498773    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"]
Oct 31 00:22:14.505490 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:14.505464    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d52ab28_2c13_4f05_8a30_610e75869c18.slice/crio-1f11472f518be398acf46d76e02f1f0083fef47c5a1b6dbdc97bcef3b57121ba WatchSource:0}: Error finding container 1f11472f518be398acf46d76e02f1f0083fef47c5a1b6dbdc97bcef3b57121ba: Status 404 returned error can't find the container with id 1f11472f518be398acf46d76e02f1f0083fef47c5a1b6dbdc97bcef3b57121ba
Oct 31 00:22:15.494606 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:15.494571    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx" event={"ID":"8d52ab28-2c13-4f05-8a30-610e75869c18","Type":"ContainerStarted","Data":"1f11472f518be398acf46d76e02f1f0083fef47c5a1b6dbdc97bcef3b57121ba"}
Oct 31 00:22:16.541219 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:16.541184    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:22:21.477983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:21.477841    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:22:21.478629 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:21.478039    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:21.641468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:21.641431    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-nkw25"]
Oct 31 00:22:21.641715 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:21.641689    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-nkw25" podUID="734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" containerName="manager" containerID="cri-o://1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1" gracePeriod=30
Oct 31 00:22:22.433073 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.432769    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:22.482551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.482518    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert\") pod \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") "
Oct 31 00:22:22.482992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.482580    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs\") pod \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") "
Oct 31 00:22:22.482992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.482673    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh\" (UniqueName: \"kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh\") pod \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\" (UID: \"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f\") "
Oct 31 00:22:22.485738 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.485708    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh" pod "734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" (UID: "734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f"). InnerVolumeSpecName "kube-api-access-rx4xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:22:22.487638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.487598    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs" pod "734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" (UID: "734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:22:22.489638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.489595    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert" pod "734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" (UID: "734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:22:22.541796 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.541712    5925 generic.go:356] "Generic (PLEG): container finished" podID="734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" containerID="1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1" exitCode=0
Oct 31 00:22:22.541796 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.541758    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-nkw25"
Oct 31 00:22:22.541991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.541788    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-nkw25" event={"ID":"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f","Type":"ContainerDied","Data":"1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1"}
Oct 31 00:22:22.541991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.541858    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-nkw25" event={"ID":"734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f","Type":"ContainerDied","Data":"20eab937c57c71462dd81c86da38241e368019882b837692bcf59490bd4691c0"}
Oct 31 00:22:22.541991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.541893    5925 scope.go:122] "RemoveContainer" containerID="1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1"
Oct 31 00:22:22.554007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.553986    5925 scope.go:122] "RemoveContainer" containerID="1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1"
Oct 31 00:22:22.554460 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:22.554407    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1\": container with ID starting with 1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1 not found: ID does not exist" containerID="1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1"
Oct 31 00:22:22.554563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.554472    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1"} err="failed to get container status \"1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1\": rpc error: code = NotFound desc = could not find container \"1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1\": container with ID starting with 1a7be9fbae6b14af8c3c3df1bfce8bcf6e5acb819cdd6064bbf961efd8c31af1 not found: ID does not exist"
Oct 31 00:22:22.584302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.584274    5925 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-webhook-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:22:22.584302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.584299    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:22:22.584302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.584314    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx4xh\" (UniqueName: \"kubernetes.io/projected/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f-kube-api-access-rx4xh\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:22:22.704529 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.704490    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-nkw25"]
Oct 31 00:22:22.712252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:22.712211    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-nkw25"]
Oct 31 00:22:24.451818 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:24.451783    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" path="/var/lib/kubelet/pods/734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f/volumes"
Oct 31 00:22:28.577512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:28.577474    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx" event={"ID":"8d52ab28-2c13-4f05-8a30-610e75869c18","Type":"ContainerStarted","Data":"6d70859c4a234e9c26302e38ccc44e31414d0c99ba3603e63c863ee6ffe2937d"}
Oct 31 00:22:28.577926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:28.577654    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:28.691162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:28.691100    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx" podStartSLOduration=2.29299891 podStartE2EDuration="15.691085114s" totalImagesPullingTime="13.398086204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:22:28.689583319 +0000 UTC m=+450.378463267" watchObservedRunningTime="2026-10-31 00:22:28.691085114 +0000 UTC m=+450.379965059"
Oct 31 00:22:39.589271 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:39.589178    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-n99lx"
Oct 31 00:22:41.623024 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.622994    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-6hlp9"]
Oct 31 00:22:41.623659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.623393    5925 cpu_manager.go:414] "containerMap: removing container" podUID="734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" containerName="manager"
Oct 31 00:22:41.623659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.623405    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" containerName="manager"
Oct 31 00:22:41.623659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.623525    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="734f88c1-ebbc-4d58-9d7b-fb8cc2ecb36f" containerName="manager"
Oct 31 00:22:41.628942 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.628919    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.746812 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.746783    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2dlcn\""
Oct 31 00:22:41.746812 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.746783    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 31 00:22:41.748918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.748896    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-6hlp9"]
Oct 31 00:22:41.761067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.761042    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753258f7-44db-4369-9adf-62a1fc9af8f3-cert\") pod \"kserve-controller-manager-776cc66d47-6hlp9\" (UID: \"753258f7-44db-4369-9adf-62a1fc9af8f3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.761179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.761098    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddkm\" (UniqueName: \"kubernetes.io/projected/753258f7-44db-4369-9adf-62a1fc9af8f3-kube-api-access-mddkm\") pod \"kserve-controller-manager-776cc66d47-6hlp9\" (UID: \"753258f7-44db-4369-9adf-62a1fc9af8f3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.861387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.861352    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-m6h68"]
Oct 31 00:22:41.861717 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.861690    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddkm\" (UniqueName: \"kubernetes.io/projected/753258f7-44db-4369-9adf-62a1fc9af8f3-kube-api-access-mddkm\") pod \"kserve-controller-manager-776cc66d47-6hlp9\" (UID: \"753258f7-44db-4369-9adf-62a1fc9af8f3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.861785 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.861755    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753258f7-44db-4369-9adf-62a1fc9af8f3-cert\") pod \"kserve-controller-manager-776cc66d47-6hlp9\" (UID: \"753258f7-44db-4369-9adf-62a1fc9af8f3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.864370 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.864346    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/753258f7-44db-4369-9adf-62a1fc9af8f3-cert\") pod \"kserve-controller-manager-776cc66d47-6hlp9\" (UID: \"753258f7-44db-4369-9adf-62a1fc9af8f3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.867456 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.867440    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:41.920650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.920616    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddkm\" (UniqueName: \"kubernetes.io/projected/753258f7-44db-4369-9adf-62a1fc9af8f3-kube-api-access-mddkm\") pod \"kserve-controller-manager-776cc66d47-6hlp9\" (UID: \"753258f7-44db-4369-9adf-62a1fc9af8f3\") " pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.923847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.923824    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-m6h68"]
Oct 31 00:22:41.939247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.939218    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 31 00:22:41.939380 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.939293    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-m7tqf\""
Oct 31 00:22:41.943381 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.943362    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:41.962323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.962296    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3283f856-53a9-4f18-a725-4d6a017f1e85-tls-certs\") pod \"model-serving-api-75bd89fdfc-m6h68\" (UID: \"3283f856-53a9-4f18-a725-4d6a017f1e85\") " pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:41.962450 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:41.962331    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnp66\" (UniqueName: \"kubernetes.io/projected/3283f856-53a9-4f18-a725-4d6a017f1e85-kube-api-access-rnp66\") pod \"model-serving-api-75bd89fdfc-m6h68\" (UID: \"3283f856-53a9-4f18-a725-4d6a017f1e85\") " pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:42.063353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.063322    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3283f856-53a9-4f18-a725-4d6a017f1e85-tls-certs\") pod \"model-serving-api-75bd89fdfc-m6h68\" (UID: \"3283f856-53a9-4f18-a725-4d6a017f1e85\") " pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:42.063353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.063356    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnp66\" (UniqueName: \"kubernetes.io/projected/3283f856-53a9-4f18-a725-4d6a017f1e85-kube-api-access-rnp66\") pod \"model-serving-api-75bd89fdfc-m6h68\" (UID: \"3283f856-53a9-4f18-a725-4d6a017f1e85\") " pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:42.065811 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.065785    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3283f856-53a9-4f18-a725-4d6a017f1e85-tls-certs\") pod \"model-serving-api-75bd89fdfc-m6h68\" (UID: \"3283f856-53a9-4f18-a725-4d6a017f1e85\") " pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:42.128485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.128406    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnp66\" (UniqueName: \"kubernetes.io/projected/3283f856-53a9-4f18-a725-4d6a017f1e85-kube-api-access-rnp66\") pod \"model-serving-api-75bd89fdfc-m6h68\" (UID: \"3283f856-53a9-4f18-a725-4d6a017f1e85\") " pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:42.186009 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.185974    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:42.323085 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.321951    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-6hlp9"]
Oct 31 00:22:42.329720 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:42.329667    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753258f7_44db_4369_9adf_62a1fc9af8f3.slice/crio-d703cc2f46aa412b416c45a952cdffd258f740f2f3286972b1778c6c66926d60 WatchSource:0}: Error finding container d703cc2f46aa412b416c45a952cdffd258f740f2f3286972b1778c6c66926d60: Status 404 returned error can't find the container with id d703cc2f46aa412b416c45a952cdffd258f740f2f3286972b1778c6c66926d60
Oct 31 00:22:42.559638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.559558    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-m6h68"]
Oct 31 00:22:42.565195 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:42.565165    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3283f856_53a9_4f18_a725_4d6a017f1e85.slice/crio-c8421f693266753866bb1789424e01173d3078066e27827d8bf3793947717508 WatchSource:0}: Error finding container c8421f693266753866bb1789424e01173d3078066e27827d8bf3793947717508: Status 404 returned error can't find the container with id c8421f693266753866bb1789424e01173d3078066e27827d8bf3793947717508
Oct 31 00:22:42.658711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.658678    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68" event={"ID":"3283f856-53a9-4f18-a725-4d6a017f1e85","Type":"ContainerStarted","Data":"c8421f693266753866bb1789424e01173d3078066e27827d8bf3793947717508"}
Oct 31 00:22:42.659894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:42.659865    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9" event={"ID":"753258f7-44db-4369-9adf-62a1fc9af8f3","Type":"ContainerStarted","Data":"d703cc2f46aa412b416c45a952cdffd258f740f2f3286972b1778c6c66926d60"}
Oct 31 00:22:45.681176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:45.681094    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68" event={"ID":"3283f856-53a9-4f18-a725-4d6a017f1e85","Type":"ContainerStarted","Data":"3c9bc19009f3fb1b19730203f83f6166e2290e2277cf14b3bbfee2bc9307e0b7"}
Oct 31 00:22:45.681651 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:45.681392    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:45.804156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:45.804093    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68" podStartSLOduration=1.9401492729999998 podStartE2EDuration="4.804075822s" totalImagesPullingTime="2.863926549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:22:45.802349408 +0000 UTC m=+467.491229355" watchObservedRunningTime="2026-10-31 00:22:45.804075822 +0000 UTC m=+467.492955786"
Oct 31 00:22:46.542713 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:46.542628    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:22:46.692296 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:46.692233    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9" event={"ID":"753258f7-44db-4369-9adf-62a1fc9af8f3","Type":"ContainerStarted","Data":"a6dd0cef3bdefd1ac5d0bdfcb42224d7cb58a0c69f6d4190b6ac1ff58e6dc2c6"}
Oct 31 00:22:46.692754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:46.692496    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:22:46.822709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:46.822623    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9" podStartSLOduration=1.999903514 podStartE2EDuration="5.822610966s" totalImagesPullingTime="3.822707452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:22:46.822322241 +0000 UTC m=+468.511202188" watchObservedRunningTime="2026-10-31 00:22:46.822610966 +0000 UTC m=+468.511490912"
Oct 31 00:22:55.986377 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:55.986339    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q967g"]
Oct 31 00:22:56.110507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.110463    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q967g"]
Oct 31 00:22:56.110701 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.110597    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:56.186659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.186621    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"]
Oct 31 00:22:56.214297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.214266    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbkh\" (UniqueName: \"kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh\") pod \"authorino-6f6944bcdd-q967g\" (UID: \"1c65ba16-2e07-4a68-8868-8f0f006f1e9f\") " pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:56.252208 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.252135    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"]
Oct 31 00:22:56.252345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.252262    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.302722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.302696    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 31 00:22:56.302722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.302707    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 31 00:22:56.302936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.302864    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 00:22:56.302936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.302917    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-v4nxh\""
Oct 31 00:22:56.302936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.302931    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 00:22:56.315540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.315513    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.315636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.315569    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbkh\" (UniqueName: \"kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh\") pod \"authorino-6f6944bcdd-q967g\" (UID: \"1c65ba16-2e07-4a68-8868-8f0f006f1e9f\") " pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:56.315636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.315589    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.315800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.315788    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.315833 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.315824    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srlt\" (UniqueName: \"kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.362262 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.362239    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q967g"]
Oct 31 00:22:56.362508 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:22:56.362486    5925 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2mbkh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-q967g" podUID="1c65ba16-2e07-4a68-8868-8f0f006f1e9f"
Oct 31 00:22:56.377237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.377209    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbkh\" (UniqueName: \"kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh\") pod \"authorino-6f6944bcdd-q967g\" (UID: \"1c65ba16-2e07-4a68-8868-8f0f006f1e9f\") " pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:56.395656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.391362    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fbf84957-4d6nq"]
Oct 31 00:22:56.416421 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.416391    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.416582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.416559    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.416658 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.416642    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.416701 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.416683    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srlt\" (UniqueName: \"kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.417218 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.417197    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.418967 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.418946    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.419041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.418976    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.475658 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.475629    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srlt\" (UniqueName: \"kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt\") pod \"maas-api-799fd7675f-82tq5\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") " pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.497544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.497513    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:22:56.503226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.503167    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fbf84957-4d6nq"]
Oct 31 00:22:56.517512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.517491    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7rtx\" (UniqueName: \"kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx\") pod \"authorino-7fbf84957-4d6nq\" (UID: \"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6\") " pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:22:56.618200 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.618165    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7rtx\" (UniqueName: \"kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx\") pod \"authorino-7fbf84957-4d6nq\" (UID: \"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6\") " pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.618603    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.668714    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": read tcp 10.132.0.2:44108->10.132.0.34:15021: read: connection reset by peer" start-of-body=
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.668783    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": read tcp 10.132.0.2:44108->10.132.0.34:15021: read: connection reset by peer"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.678149    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7rtx\" (UniqueName: \"kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx\") pod \"authorino-7fbf84957-4d6nq\" (UID: \"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6\") " pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.678371    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fbf84957-4d6nq"]
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.678586    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.699809    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-m6h68"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.715585    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6897f696b7-q2grc"]
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.736001    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.760402    5925 generic.go:356] "Generic (PLEG): container finished" podID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerID="5b1f3c92e8327a860d4af1568918e7d5548c8ffbc4a8b8faf3d46145f0a11498" exitCode=0
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.760458    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" event={"ID":"f37e7568-ca40-42a9-aadc-bdb63bac1c52","Type":"ContainerDied","Data":"5b1f3c92e8327a860d4af1568918e7d5548c8ffbc4a8b8faf3d46145f0a11498"}
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.760804    5925 scope.go:122] "RemoveContainer" containerID="5b1f3c92e8327a860d4af1568918e7d5548c8ffbc4a8b8faf3d46145f0a11498"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.761114    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.765731    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.765811    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.765858    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.773886    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6897f696b7-q2grc"]
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.786271    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.789276    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.820175    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh\" (UniqueName: \"kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh\") pod \"1c65ba16-2e07-4a68-8868-8f0f006f1e9f\" (UID: \"1c65ba16-2e07-4a68-8868-8f0f006f1e9f\") "
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.820343    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6png\" (UniqueName: \"kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png\") pod \"authorino-6897f696b7-q2grc\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") " pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.820391    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert\") pod \"authorino-6897f696b7-q2grc\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") " pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:56.826915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.822070    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh" pod "1c65ba16-2e07-4a68-8868-8f0f006f1e9f" (UID: "1c65ba16-2e07-4a68-8868-8f0f006f1e9f"). InnerVolumeSpecName "kube-api-access-2mbkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:22:56.921424 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.921377    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6png\" (UniqueName: \"kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png\") pod \"authorino-6897f696b7-q2grc\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") " pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:56.921591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.921452    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert\") pod \"authorino-6897f696b7-q2grc\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") " pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:56.921591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.921492    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mbkh\" (UniqueName: \"kubernetes.io/projected/1c65ba16-2e07-4a68-8868-8f0f006f1e9f-kube-api-access-2mbkh\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:22:56.923851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.923824    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert\") pod \"authorino-6897f696b7-q2grc\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") " pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:56.979303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:56.979276    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6png\" (UniqueName: \"kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png\") pod \"authorino-6897f696b7-q2grc\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") " pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:57.024538 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.024508    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"]
Oct 31 00:22:57.031029 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:57.031002    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e1e827_0c14_45d5_b6f0_ae6403a4c8ca.slice/crio-8b459577ab2c7a240c8cbc5661511c7511ed81b9a70781b8f1e2a67c6d691a5a WatchSource:0}: Error finding container 8b459577ab2c7a240c8cbc5661511c7511ed81b9a70781b8f1e2a67c6d691a5a: Status 404 returned error can't find the container with id 8b459577ab2c7a240c8cbc5661511c7511ed81b9a70781b8f1e2a67c6d691a5a
Oct 31 00:22:57.061217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.061191    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:22:57.072921 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.072887    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fbf84957-4d6nq"]
Oct 31 00:22:57.079319 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:57.079290    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3ca96a2_d8b8_43fc_97a9_bc0a729f2da6.slice/crio-403cb95d14cccf5ca3dc8ba594e67475b3eefb6f93700351d8f2349e0fab388f WatchSource:0}: Error finding container 403cb95d14cccf5ca3dc8ba594e67475b3eefb6f93700351d8f2349e0fab388f: Status 404 returned error can't find the container with id 403cb95d14cccf5ca3dc8ba594e67475b3eefb6f93700351d8f2349e0fab388f
Oct 31 00:22:57.465724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.465688    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6897f696b7-q2grc"]
Oct 31 00:22:57.470880 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:22:57.470849    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd346480_63cb_4e4d_9c6c_500ccf1af521.slice/crio-973fa0051230a1f5b3b9bcabe5c020c9842ba6419a8f3204f2b1bf335cfcd8b9 WatchSource:0}: Error finding container 973fa0051230a1f5b3b9bcabe5c020c9842ba6419a8f3204f2b1bf335cfcd8b9: Status 404 returned error can't find the container with id 973fa0051230a1f5b3b9bcabe5c020c9842ba6419a8f3204f2b1bf335cfcd8b9
Oct 31 00:22:57.773184 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.773093    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" event={"ID":"f37e7568-ca40-42a9-aadc-bdb63bac1c52","Type":"ContainerStarted","Data":"6194892096b8eafbc8030677bcbc45d367e16003fe78fc674fc2a599eded2058"}
Oct 31 00:22:57.774436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.774392    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fbf84957-4d6nq" event={"ID":"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6","Type":"ContainerStarted","Data":"403cb95d14cccf5ca3dc8ba594e67475b3eefb6f93700351d8f2349e0fab388f"}
Oct 31 00:22:57.775671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.775650    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5" event={"ID":"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca","Type":"ContainerStarted","Data":"8b459577ab2c7a240c8cbc5661511c7511ed81b9a70781b8f1e2a67c6d691a5a"}
Oct 31 00:22:57.776730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.776704    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6897f696b7-q2grc" event={"ID":"dd346480-63cb-4e4d-9c6c-500ccf1af521","Type":"ContainerStarted","Data":"973fa0051230a1f5b3b9bcabe5c020c9842ba6419a8f3204f2b1bf335cfcd8b9"}
Oct 31 00:22:57.776829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:57.776717    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-q967g"
Oct 31 00:22:58.065493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:58.063651    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q967g"]
Oct 31 00:22:58.067476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:58.067445    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-q967g"]
Oct 31 00:22:58.375119 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:58.375078    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:22:58.375317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:58.375292    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 00:22:58.375372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:58.375350    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 00:22:58.471997 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:58.471965    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1c65ba16-2e07-4a68-8868-8f0f006f1e9f" path="/var/lib/kubelet/pods/1c65ba16-2e07-4a68-8868-8f0f006f1e9f/volumes"
Oct 31 00:22:59.375514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:59.375472    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 00:22:59.375984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:59.375545    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 00:22:59.793434 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:59.791602    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fbf84957-4d6nq" event={"ID":"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6","Type":"ContainerStarted","Data":"7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1"}
Oct 31 00:22:59.793434 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:59.791747    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7fbf84957-4d6nq" podUID="c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" containerName="authorino" containerID="cri-o://7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1" gracePeriod=30
Oct 31 00:22:59.794584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:22:59.794547    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6897f696b7-q2grc" event={"ID":"dd346480-63cb-4e4d-9c6c-500ccf1af521","Type":"ContainerStarted","Data":"41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04"}
Oct 31 00:23:00.023538 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.023145    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6897f696b7-q2grc" podStartSLOduration=2.319484142 podStartE2EDuration="4.02312614s" totalImagesPullingTime="1.703641998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:23:00.020640983 +0000 UTC m=+481.709520930" watchObservedRunningTime="2026-10-31 00:23:00.02312614 +0000 UTC m=+481.712006091"
Oct 31 00:23:00.023538 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.023383    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7fbf84957-4d6nq" podStartSLOduration=2.139354511 podStartE2EDuration="4.023371921s" totalImagesPullingTime="1.88401741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:22:59.906850824 +0000 UTC m=+481.595730770" watchObservedRunningTime="2026-10-31 00:23:00.023371921 +0000 UTC m=+481.712251868"
Oct 31 00:23:00.074365 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.071177    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-6bhf9"]
Oct 31 00:23:00.074365 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.071378    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9" podUID="01da0bef-a80b-4175-9fb8-30115c94ae4c" containerName="authorino" containerID="cri-o://1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9" gracePeriod=30
Oct 31 00:23:00.216150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.216118    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:23:00.275024 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.274976    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx\" (UniqueName: \"kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx\") pod \"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6\" (UID: \"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6\") "
Oct 31 00:23:00.278494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.277451    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx" pod "c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" (UID: "c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6"). InnerVolumeSpecName "kube-api-access-p7rtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:23:00.377704 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.375662    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 00:23:00.377704 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.375722    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 00:23:00.377704 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.376445    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7rtx\" (UniqueName: \"kubernetes.io/projected/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6-kube-api-access-p7rtx\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:23:00.422337 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.422309    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:23:00.479036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.479007    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq\" (UniqueName: \"kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq\") pod \"01da0bef-a80b-4175-9fb8-30115c94ae4c\" (UID: \"01da0bef-a80b-4175-9fb8-30115c94ae4c\") "
Oct 31 00:23:00.481962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.481935    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq" pod "01da0bef-a80b-4175-9fb8-30115c94ae4c" (UID: "01da0bef-a80b-4175-9fb8-30115c94ae4c"). InnerVolumeSpecName "kube-api-access-cxlfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:23:00.580316 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.580276    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxlfq\" (UniqueName: \"kubernetes.io/projected/01da0bef-a80b-4175-9fb8-30115c94ae4c-kube-api-access-cxlfq\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:23:00.803046 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.803014    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5" event={"ID":"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca","Type":"ContainerStarted","Data":"1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5"}
Oct 31 00:23:00.803889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.803870    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:23:00.805027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.804998    5925 generic.go:356] "Generic (PLEG): container finished" podID="01da0bef-a80b-4175-9fb8-30115c94ae4c" containerID="1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9" exitCode=0
Oct 31 00:23:00.805168 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.805125    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9" event={"ID":"01da0bef-a80b-4175-9fb8-30115c94ae4c","Type":"ContainerDied","Data":"1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9"}
Oct 31 00:23:00.805168 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.805155    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9" event={"ID":"01da0bef-a80b-4175-9fb8-30115c94ae4c","Type":"ContainerDied","Data":"1e85de25f7b58945f82705fa5bb21cc4067d839cb1b58868fa6ad37a2087e40a"}
Oct 31 00:23:00.805276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.805176    5925 scope.go:122] "RemoveContainer" containerID="1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9"
Oct 31 00:23:00.805328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.805314    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-6bhf9"
Oct 31 00:23:00.807368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.807340    5925 generic.go:356] "Generic (PLEG): container finished" podID="c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" containerID="7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1" exitCode=0
Oct 31 00:23:00.807816 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.807797    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fbf84957-4d6nq"
Oct 31 00:23:00.811582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.808215    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fbf84957-4d6nq" event={"ID":"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6","Type":"ContainerDied","Data":"7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1"}
Oct 31 00:23:00.811582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.808253    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fbf84957-4d6nq" event={"ID":"c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6","Type":"ContainerDied","Data":"403cb95d14cccf5ca3dc8ba594e67475b3eefb6f93700351d8f2349e0fab388f"}
Oct 31 00:23:00.816897 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.816877    5925 scope.go:122] "RemoveContainer" containerID="1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9"
Oct 31 00:23:00.817254 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:23:00.817138    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9\": container with ID starting with 1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9 not found: ID does not exist" containerID="1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9"
Oct 31 00:23:00.817254 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.817165    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9"} err="failed to get container status \"1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9\": rpc error: code = NotFound desc = could not find container \"1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9\": container with ID starting with 1366ba91d40842edba0653b757afae4f1e9fbcac76b4b0028e66e0844bb9ada9 not found: ID does not exist"
Oct 31 00:23:00.817254 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.817182    5925 scope.go:122] "RemoveContainer" containerID="7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1"
Oct 31 00:23:00.826328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.826314    5925 scope.go:122] "RemoveContainer" containerID="7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1"
Oct 31 00:23:00.826606 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:23:00.826584    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1\": container with ID starting with 7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1 not found: ID does not exist" containerID="7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1"
Oct 31 00:23:00.826673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.826614    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1"} err="failed to get container status \"7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1\": rpc error: code = NotFound desc = could not find container \"7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1\": container with ID starting with 7e096b0fbfd635531a1be685cb2d9b3ae7e7706d054fe6c512b68a2f9df588e1 not found: ID does not exist"
Oct 31 00:23:00.924145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:00.921317    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5" podStartSLOduration=1.244188339 podStartE2EDuration="4.921303199s" totalImagesPullingTime="3.67711486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:23:00.919396977 +0000 UTC m=+482.608276946" watchObservedRunningTime="2026-10-31 00:23:00.921303199 +0000 UTC m=+482.610183145"
Oct 31 00:23:01.026052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:01.025961    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-6bhf9"]
Oct 31 00:23:01.033656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:01.033626    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-6bhf9"]
Oct 31 00:23:01.137493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:01.137460    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fbf84957-4d6nq"]
Oct 31 00:23:01.162438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:01.161721    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fbf84957-4d6nq"]
Oct 31 00:23:01.374912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:01.374884    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 00:23:01.375087 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:01.374937    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 00:23:02.375210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:02.375171    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 00:23:02.375698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:02.375229    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 00:23:02.469991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:02.469951    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01da0bef-a80b-4175-9fb8-30115c94ae4c" path="/var/lib/kubelet/pods/01da0bef-a80b-4175-9fb8-30115c94ae4c/volumes"
Oct 31 00:23:02.470676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:02.470647    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" path="/var/lib/kubelet/pods/c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6/volumes"
Oct 31 00:23:03.378261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:03.378227    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:23:03.378654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:03.378539    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:23:03.379305 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:03.379289    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b"
Oct 31 00:23:07.825334 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:07.825304    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 00:23:16.541816 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:23:16.541772    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:23:17.702953 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:23:17.702920    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-6hlp9"
Oct 31 00:23:46.541753 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:23:46.541712    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:24:16.541448 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:24:16.541348    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:24:39.319397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:39.319360    5925 generic.go:356] "Generic (PLEG): container finished" podID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerID="876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467" exitCode=1
Oct 31 00:24:39.319834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:39.319449    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" event={"ID":"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c","Type":"ContainerDied","Data":"876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"}
Oct 31 00:24:39.319834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:39.319798    5925 scope.go:122] "RemoveContainer" containerID="876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"
Oct 31 00:24:41.334901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:41.334867    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" event={"ID":"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c","Type":"ContainerStarted","Data":"b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb"}
Oct 31 00:24:41.335277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:41.335128    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:24:46.543208 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:24:46.543170    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:24:52.343375 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:52.343344    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 00:24:54.243695 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.243662    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"]
Oct 31 00:24:54.244087 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.244057    5925 cpu_manager.go:414] "containerMap: removing container" podUID="01da0bef-a80b-4175-9fb8-30115c94ae4c" containerName="authorino"
Oct 31 00:24:54.244087 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.244068    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01da0bef-a80b-4175-9fb8-30115c94ae4c" containerName="authorino"
Oct 31 00:24:54.244087 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.244080    5925 cpu_manager.go:414] "containerMap: removing container" podUID="c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" containerName="authorino"
Oct 31 00:24:54.244087 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.244086    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" containerName="authorino"
Oct 31 00:24:54.244216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.244153    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="01da0bef-a80b-4175-9fb8-30115c94ae4c" containerName="authorino"
Oct 31 00:24:54.244216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.244161    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="c3ca96a2-d8b8-43fc-97a9-bc0a729f2da6" containerName="authorino"
Oct 31 00:24:54.247422 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.247393    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.297557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.297527    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 31 00:24:54.344778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.344743    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 31 00:24:54.344778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.344743    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 31 00:24:54.344964 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.344834    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hg9vc\""
Oct 31 00:24:54.346852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.346833    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"]
Oct 31 00:24:54.419631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.419600    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29677d27-bc2f-4905-966f-2fad1ee2b299-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.419822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.419641    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.419822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.419668    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.419822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.419719    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.419822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.419758    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsdt6\" (UniqueName: \"kubernetes.io/projected/29677d27-bc2f-4905-966f-2fad1ee2b299-kube-api-access-dsdt6\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.419992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.419908    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.520685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.520602    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.520685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.520657    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29677d27-bc2f-4905-966f-2fad1ee2b299-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.520985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.520703    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.520985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.520734    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.520985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.520761    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.520985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.520783    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsdt6\" (UniqueName: \"kubernetes.io/projected/29677d27-bc2f-4905-966f-2fad1ee2b299-kube-api-access-dsdt6\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.521189 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.521081    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.521189 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.521099    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.521255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.521194    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.523039 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.523009    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29677d27-bc2f-4905-966f-2fad1ee2b299-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.523289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.523273    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29677d27-bc2f-4905-966f-2fad1ee2b299-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.579798 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.579765    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsdt6\" (UniqueName: \"kubernetes.io/projected/29677d27-bc2f-4905-966f-2fad1ee2b299-kube-api-access-dsdt6\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-qtlrw\" (UID: \"29677d27-bc2f-4905-966f-2fad1ee2b299\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:54.861077 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:54.861038    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:24:55.236114 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:55.236031    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"]
Oct 31 00:24:55.242723 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:24:55.242698    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29677d27_bc2f_4905_966f_2fad1ee2b299.slice/crio-0a61301a9d34bb84b96be00449795efb3dbef1f0aa17125dadff7a14c56c9141 WatchSource:0}: Error finding container 0a61301a9d34bb84b96be00449795efb3dbef1f0aa17125dadff7a14c56c9141: Status 404 returned error can't find the container with id 0a61301a9d34bb84b96be00449795efb3dbef1f0aa17125dadff7a14c56c9141
Oct 31 00:24:55.409644 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:55.409608    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw" event={"ID":"29677d27-bc2f-4905-966f-2fad1ee2b299","Type":"ContainerStarted","Data":"0a61301a9d34bb84b96be00449795efb3dbef1f0aa17125dadff7a14c56c9141"}
Oct 31 00:24:58.427729 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:58.427691    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw" event={"ID":"29677d27-bc2f-4905-966f-2fad1ee2b299","Type":"ContainerStarted","Data":"98a461f761ded4b838d050178842025a9d013b8a0b8b10c55c9cac554ead10ac"}
Oct 31 00:24:58.542374 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:58.542341    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:24:58.542574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:58.542479    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw" podStartSLOduration=2.030515233 podStartE2EDuration="4.542467521s" totalImagesPullingTime="2.511952288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:24:58.540121444 +0000 UTC m=+600.229001416" watchObservedRunningTime="2026-10-31 00:24:58.542467521 +0000 UTC m=+600.231347467"
Oct 31 00:24:58.546703 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:58.546680    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:24:58.861499 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:24:58.861470    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:25:00.844431 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.844379    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"]
Oct 31 00:25:00.848214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.848194    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:00.898160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.898137    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 31 00:25:00.906757 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.906730    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"]
Oct 31 00:25:00.981038 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.981004    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:00.981196 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.981046    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:00.981240 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.981197    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58c6dc90-68f5-4c2e-9342-338eba848e8f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:00.981240 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.981229    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljkd\" (UniqueName: \"kubernetes.io/projected/58c6dc90-68f5-4c2e-9342-338eba848e8f-kube-api-access-4ljkd\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:00.981316 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.981249    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:00.981358 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:00.981325    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.081783 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.081749    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58c6dc90-68f5-4c2e-9342-338eba848e8f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.081783 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.081785    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljkd\" (UniqueName: \"kubernetes.io/projected/58c6dc90-68f5-4c2e-9342-338eba848e8f-kube-api-access-4ljkd\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.081783 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.081802    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.082105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.081868    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.082105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.081960    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.082105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.082002    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.082267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.082224    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.082380 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.082357    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.082593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.082454    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.084272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.084249    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58c6dc90-68f5-4c2e-9342-338eba848e8f-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.084912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.084892    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58c6dc90-68f5-4c2e-9342-338eba848e8f-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.140863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.140791    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljkd\" (UniqueName: \"kubernetes.io/projected/58c6dc90-68f5-4c2e-9342-338eba848e8f-kube-api-access-4ljkd\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-2vslx\" (UID: \"58c6dc90-68f5-4c2e-9342-338eba848e8f\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.161378 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.161349    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:01.544013 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:01.543928    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"]
Oct 31 00:25:01.550716 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:01.550689    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c6dc90_68f5_4c2e_9342_338eba848e8f.slice/crio-9c877863bf65e8542056738b3b6de569c96e61a3fd0fdb334b1366d56e86b6a6 WatchSource:0}: Error finding container 9c877863bf65e8542056738b3b6de569c96e61a3fd0fdb334b1366d56e86b6a6: Status 404 returned error can't find the container with id 9c877863bf65e8542056738b3b6de569c96e61a3fd0fdb334b1366d56e86b6a6
Oct 31 00:25:02.451605 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:02.451573    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx" event={"ID":"58c6dc90-68f5-4c2e-9342-338eba848e8f","Type":"ContainerStarted","Data":"120dea74c24dd0a1e3f54bb636c1d35830404f1bf7cbd1b7564d74ac9858f79a"}
Oct 31 00:25:02.451982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:02.451624    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx" event={"ID":"58c6dc90-68f5-4c2e-9342-338eba848e8f","Type":"ContainerStarted","Data":"9c877863bf65e8542056738b3b6de569c96e61a3fd0fdb334b1366d56e86b6a6"}
Oct 31 00:25:02.563606 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:02.563501    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx" podStartSLOduration=1.880139545 podStartE2EDuration="2.563487562s" totalImagesPullingTime="683.348017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:02.561489657 +0000 UTC m=+604.250369603" watchObservedRunningTime="2026-10-31 00:25:02.563487562 +0000 UTC m=+604.252367507"
Oct 31 00:25:03.162010 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:03.161973    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:04.483910 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.483871    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"]
Oct 31 00:25:04.487606 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.487582    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.537589 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.537554    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 31 00:25:04.586816 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.586787    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"]
Oct 31 00:25:04.614470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.614436    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.614610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.614499    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.614610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.614522    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ggs\" (UniqueName: \"kubernetes.io/projected/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-kube-api-access-z2ggs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.614683 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.614663    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.614762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.614743    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.614802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.614781    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.715566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.715530    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.715566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.715569    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ggs\" (UniqueName: \"kubernetes.io/projected/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-kube-api-access-z2ggs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.715773 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.715667    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.715773 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.715714    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.715773 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.715740    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.715902 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.715786    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.716033 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.716005    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.716108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.716065    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.716189 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.716164    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.717888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.717865    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.718255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.718237    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.774523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.774445    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ggs\" (UniqueName: \"kubernetes.io/projected/24e4c0b0-dea7-4a57-97b5-c285d31ab68d-kube-api-access-z2ggs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-2qt9q\" (UID: \"24e4c0b0-dea7-4a57-97b5-c285d31ab68d\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.800262 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.800230    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:04.862500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.861717    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:25:04.879544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:04.879519    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:25:05.179613 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:05.179577    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"]
Oct 31 00:25:05.186149 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:05.186116    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24e4c0b0_dea7_4a57_97b5_c285d31ab68d.slice/crio-a5c1401c3be202bbfec1e0eaab44ffc35d81859b45464b8748ce3c7f26051cfa WatchSource:0}: Error finding container a5c1401c3be202bbfec1e0eaab44ffc35d81859b45464b8748ce3c7f26051cfa: Status 404 returned error can't find the container with id a5c1401c3be202bbfec1e0eaab44ffc35d81859b45464b8748ce3c7f26051cfa
Oct 31 00:25:05.466600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:05.466501    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q" event={"ID":"24e4c0b0-dea7-4a57-97b5-c285d31ab68d","Type":"ContainerStarted","Data":"a5c1401c3be202bbfec1e0eaab44ffc35d81859b45464b8748ce3c7f26051cfa"}
Oct 31 00:25:05.477824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:05.477795    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-qtlrw"
Oct 31 00:25:06.473868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:06.473830    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q" event={"ID":"24e4c0b0-dea7-4a57-97b5-c285d31ab68d","Type":"ContainerStarted","Data":"79c2be5cd3bcdcb349fd02249e260b4d23e27d198094ec2561ab684eed87993c"}
Oct 31 00:25:06.587342 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:06.587292    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q" podStartSLOduration=1.932003122 podStartE2EDuration="2.58727987s" totalImagesPullingTime="655.276748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:06.586140926 +0000 UTC m=+608.275020883" watchObservedRunningTime="2026-10-31 00:25:06.58727987 +0000 UTC m=+608.276159816"
Oct 31 00:25:06.800641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:06.800542    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:07.367784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.367749    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"]
Oct 31 00:25:07.371488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.371465    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.468874 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.468847    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Oct 31 00:25:07.471000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.470979    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"]
Oct 31 00:25:07.540862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.540829    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.540862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.540864    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.541267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.540887    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.541267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.541020    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.541267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.541056    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.541267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.541075    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77l89\" (UniqueName: \"kubernetes.io/projected/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-kube-api-access-77l89\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.641916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.641830    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.641916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.641868    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.641916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.641888    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77l89\" (UniqueName: \"kubernetes.io/projected/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-kube-api-access-77l89\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.642207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.642140    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.642207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.642186    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.642313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.642226    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.642790 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.642760    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.642940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.642801    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.642940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.642879    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.644310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.644283    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.644515 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.644496    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.702221 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.702190    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77l89\" (UniqueName: \"kubernetes.io/projected/5ebcd7ad-6829-4857-a4d7-b76b548e62ab-kube-api-access-77l89\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf\" (UID: \"5ebcd7ad-6829-4857-a4d7-b76b548e62ab\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:07.984768 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:07.984693    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:08.359890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:08.359847    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"]
Oct 31 00:25:08.366383 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:08.366352    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ebcd7ad_6829_4857_a4d7_b76b548e62ab.slice/crio-ee41eb23628d09b6b018b8f46869b319a5f178bbe0b71551d9ff1aa0767596f4 WatchSource:0}: Error finding container ee41eb23628d09b6b018b8f46869b319a5f178bbe0b71551d9ff1aa0767596f4: Status 404 returned error can't find the container with id ee41eb23628d09b6b018b8f46869b319a5f178bbe0b71551d9ff1aa0767596f4
Oct 31 00:25:08.486575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:08.486544    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf" event={"ID":"5ebcd7ad-6829-4857-a4d7-b76b548e62ab","Type":"ContainerStarted","Data":"ee41eb23628d09b6b018b8f46869b319a5f178bbe0b71551d9ff1aa0767596f4"}
Oct 31 00:25:09.495016 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:09.494976    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf" event={"ID":"5ebcd7ad-6829-4857-a4d7-b76b548e62ab","Type":"ContainerStarted","Data":"ffd4b1d514c21407989b70cdb152f377d1712779326ff21c8a882524e2fbc36e"}
Oct 31 00:25:09.610754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:09.610695    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf" podStartSLOduration=1.980980527 podStartE2EDuration="2.610682265s" totalImagesPullingTime="629.701738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:09.609041097 +0000 UTC m=+611.297921046" watchObservedRunningTime="2026-10-31 00:25:09.610682265 +0000 UTC m=+611.299562262"
Oct 31 00:25:09.985076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:09.985036    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:11.161829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.161790    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:11.179147 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.179118    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:11.417491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.417392    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-wskrh"]
Oct 31 00:25:11.421230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.421208    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.471534 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.471495    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 31 00:25:11.479132 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.479106    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9cd\" (UniqueName: \"kubernetes.io/projected/35f1d210-0daa-47b6-8116-788c6839d95e-kube-api-access-bw9cd\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.479273 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.479156    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.479329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.479308    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-home\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.479371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.479341    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.479476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.479458    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.479526 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.479510    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35f1d210-0daa-47b6-8116-788c6839d95e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.481312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.481290    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-wskrh"]
Oct 31 00:25:11.520534 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.520503    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-2vslx"
Oct 31 00:25:11.580880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.580848    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.580893    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35f1d210-0daa-47b6-8116-788c6839d95e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.580921    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9cd\" (UniqueName: \"kubernetes.io/projected/35f1d210-0daa-47b6-8116-788c6839d95e-kube-api-access-bw9cd\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.580949    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.580997    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-home\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.581022    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581655 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.581396    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581655 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.581586    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.581831 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.581720    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-home\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.583352 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.583330    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35f1d210-0daa-47b6-8116-788c6839d95e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.583477 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.583430    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35f1d210-0daa-47b6-8116-788c6839d95e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.641984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.641955    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9cd\" (UniqueName: \"kubernetes.io/projected/35f1d210-0daa-47b6-8116-788c6839d95e-kube-api-access-bw9cd\") pod \"echo-simulator-kserve-64b6f8f96c-wskrh\" (UID: \"35f1d210-0daa-47b6-8116-788c6839d95e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:11.734234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:11.734155    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:12.108123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:12.108086    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-wskrh"]
Oct 31 00:25:12.114768 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:12.114737    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f1d210_0daa_47b6_8116_788c6839d95e.slice/crio-3f626d5d1394da7ae1aa532d429bd0617163a3b722cb0b7934d6865fe77776d8 WatchSource:0}: Error finding container 3f626d5d1394da7ae1aa532d429bd0617163a3b722cb0b7934d6865fe77776d8: Status 404 returned error can't find the container with id 3f626d5d1394da7ae1aa532d429bd0617163a3b722cb0b7934d6865fe77776d8
Oct 31 00:25:12.116178 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:12.116158    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:25:12.515460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:12.515363    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh" event={"ID":"35f1d210-0daa-47b6-8116-788c6839d95e","Type":"ContainerStarted","Data":"3f626d5d1394da7ae1aa532d429bd0617163a3b722cb0b7934d6865fe77776d8"}
Oct 31 00:25:14.801034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:14.800992    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:14.813057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:14.813029    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:15.535766 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:15.535730    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh" event={"ID":"35f1d210-0daa-47b6-8116-788c6839d95e","Type":"ContainerStarted","Data":"d0f7d3109ad95770f2fece9a71ac046e194f424f4b873c388ea1c59be6a9f254"}
Oct 31 00:25:15.546662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:15.546638    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-2qt9q"
Oct 31 00:25:15.648709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:15.648662    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh" podStartSLOduration=2.124609047 podStartE2EDuration="4.648650899s" totalImagesPullingTime="2.524041852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:15.648324256 +0000 UTC m=+617.337204203" watchObservedRunningTime="2026-10-31 00:25:15.648650899 +0000 UTC m=+617.337530845"
Oct 31 00:25:15.735346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:15.735313    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:16.541920 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:25:16.541874    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:25:17.984937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:17.984894    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:18.004921 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:18.004891    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:18.565986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:18.565960    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf"
Oct 31 00:25:21.735091 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:21.735057    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:21.748192 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:21.748162    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:22.589511 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:22.589481    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-wskrh"
Oct 31 00:25:23.455483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.455443    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"]
Oct 31 00:25:23.459876 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.459851    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.492403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.491926    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmzcg\" (UniqueName: \"kubernetes.io/projected/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-kube-api-access-hmzcg\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.492403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.491983    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.492403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.492031    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.492403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.492056    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.492403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.492117    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.492403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.492207    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.510443 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.510397    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 31 00:25:23.559283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.559252    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"]
Oct 31 00:25:23.592866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.592830    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.592880    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmzcg\" (UniqueName: \"kubernetes.io/projected/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-kube-api-access-hmzcg\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.592975    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593195 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.593072    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593195 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.593102    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593195 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.593178    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593355 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.593278    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.593503    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.593589 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.593560    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.595927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.595903    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.596742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.596665    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.654981 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.654938    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmzcg\" (UniqueName: \"kubernetes.io/projected/85f0e456-4f56-4a9e-810c-6e9c63c7ead4-kube-api-access-hmzcg\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9\" (UID: \"85f0e456-4f56-4a9e-810c-6e9c63c7ead4\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:23.775460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:23.775358    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:24.164192 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:24.164149    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"]
Oct 31 00:25:24.172249 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:24.172215    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f0e456_4f56_4a9e_810c_6e9c63c7ead4.slice/crio-ea0426e42a3fab942eb818a22f3328bfffecd2af68cd0054291a0c7455094ee7 WatchSource:0}: Error finding container ea0426e42a3fab942eb818a22f3328bfffecd2af68cd0054291a0c7455094ee7: Status 404 returned error can't find the container with id ea0426e42a3fab942eb818a22f3328bfffecd2af68cd0054291a0c7455094ee7
Oct 31 00:25:24.610978 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:24.610941    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9" event={"ID":"85f0e456-4f56-4a9e-810c-6e9c63c7ead4","Type":"ContainerStarted","Data":"ea0426e42a3fab942eb818a22f3328bfffecd2af68cd0054291a0c7455094ee7"}
Oct 31 00:25:25.618062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:25.618024    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9" event={"ID":"85f0e456-4f56-4a9e-810c-6e9c63c7ead4","Type":"ContainerStarted","Data":"7cde50f5e868ea2cdaecfc171224383af87a84e7fd145e59a7a69e07847e0313"}
Oct 31 00:25:25.730928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:25.730874    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9" podStartSLOduration=2.136727484 podStartE2EDuration="2.73086121s" totalImagesPullingTime="594.133726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:25.730561469 +0000 UTC m=+627.419441429" watchObservedRunningTime="2026-10-31 00:25:25.73086121 +0000 UTC m=+627.419741161"
Oct 31 00:25:25.776188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:25.776157    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:31.526850 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.526816    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"]
Oct 31 00:25:31.530765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.530744    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.629497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.629464    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"]
Oct 31 00:25:31.677387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677355    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677391    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677406    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677539    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677669 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677611    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677665    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677741    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677844 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677831    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd4ht\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.677879 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.677857    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778626 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778548    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778626 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778585    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778657    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd4ht\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778765    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778822    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778849    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.778898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778876    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778967    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.778993    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.779037    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.779218    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779339 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.779310    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.779431    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.779694 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.779668    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.781095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.781073    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.781451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.781436    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.837279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.837251    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.837555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.837534    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd4ht\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht\") pod \"maas-default-gateway-openshift-default-6886b96f9-qkkjs\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:31.843338 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:31.843317    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:32.272816 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.272777    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"]
Oct 31 00:25:32.279671 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:32.279628    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2446d6f0_e254_4ac5_85c4_d5b0e4fb851b.slice/crio-106c543b29af4ca9c5947b1ff9647ed748a0af0ad38fb635d1dcef8286b7f239 WatchSource:0}: Error finding container 106c543b29af4ca9c5947b1ff9647ed748a0af0ad38fb635d1dcef8286b7f239: Status 404 returned error can't find the container with id 106c543b29af4ca9c5947b1ff9647ed748a0af0ad38fb635d1dcef8286b7f239
Oct 31 00:25:32.281366 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.281336    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:25:32.281496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.281403    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:25:32.281496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.281479    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:25:32.660611 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.660560    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" event={"ID":"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b","Type":"ContainerStarted","Data":"a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997"}
Oct 31 00:25:32.661124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.660636    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" event={"ID":"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b","Type":"ContainerStarted","Data":"106c543b29af4ca9c5947b1ff9647ed748a0af0ad38fb635d1dcef8286b7f239"}
Oct 31 00:25:32.844441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:32.843493    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:33.775720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:33.775682    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:33.788656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:33.788626    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:33.863439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:33.861841    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qkkjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 00:25:33.863439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:33.861897    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 00:25:33.903063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:33.903014    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podStartSLOduration=2.903000294 podStartE2EDuration="2.903000294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:32.781704909 +0000 UTC m=+634.470584856" watchObservedRunningTime="2026-10-31 00:25:33.903000294 +0000 UTC m=+635.591880237"
Oct 31 00:25:34.694935 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:34.694899    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9"
Oct 31 00:25:34.844849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:34.844810    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qkkjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 00:25:34.845448 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:34.845392    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 00:25:35.853438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:35.845535    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qkkjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 00:25:35.853438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:35.845601    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 00:25:36.859438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:36.845782    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qkkjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 00:25:36.859438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:36.845861    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 00:25:37.844792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:37.844752    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qkkjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 00:25:37.845041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:37.845014    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 00:25:38.844612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:38.844570    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qkkjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 00:25:38.845017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:38.844636    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 00:25:40.529632 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:40.529602    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:40.530507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:40.530482    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:40.531371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:40.531348    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:25:46.541791 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:25:46.541751    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:25:49.014765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.014730    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68c46f9484-lpckr"]
Oct 31 00:25:49.023041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.023014    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.075491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.075465    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c46f9484-lpckr"]
Oct 31 00:25:49.173502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.173466    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e3a1ea8-355d-4fe3-a7d9-388e908b80a4-tls-cert\") pod \"authorino-68c46f9484-lpckr\" (UID: \"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4\") " pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.173686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.173586    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z8dc\" (UniqueName: \"kubernetes.io/projected/1e3a1ea8-355d-4fe3-a7d9-388e908b80a4-kube-api-access-6z8dc\") pod \"authorino-68c46f9484-lpckr\" (UID: \"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4\") " pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.186924 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.186886    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"]
Oct 31 00:25:49.190897 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.190878    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.243478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.243446    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 31 00:25:49.251497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.251470    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"]
Oct 31 00:25:49.260508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.260486    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 31 00:25:49.260620 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.260509    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-jxxll\""
Oct 31 00:25:49.275128 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.275061    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z8dc\" (UniqueName: \"kubernetes.io/projected/1e3a1ea8-355d-4fe3-a7d9-388e908b80a4-kube-api-access-6z8dc\") pod \"authorino-68c46f9484-lpckr\" (UID: \"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4\") " pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.275253 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.275236    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e3a1ea8-355d-4fe3-a7d9-388e908b80a4-tls-cert\") pod \"authorino-68c46f9484-lpckr\" (UID: \"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4\") " pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.277889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.277864    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1e3a1ea8-355d-4fe3-a7d9-388e908b80a4-tls-cert\") pod \"authorino-68c46f9484-lpckr\" (UID: \"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4\") " pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.334945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.334914    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z8dc\" (UniqueName: \"kubernetes.io/projected/1e3a1ea8-355d-4fe3-a7d9-388e908b80a4-kube-api-access-6z8dc\") pod \"authorino-68c46f9484-lpckr\" (UID: \"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4\") " pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.335508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.335489    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68c46f9484-lpckr"
Oct 31 00:25:49.376754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.376461    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-wn79w\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.376754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.376539    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs54j\" (UniqueName: \"kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j\") pod \"ai-gateway-controller-5f6dd4f69f-wn79w\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.479051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.479021    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-wn79w\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.479244 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.479080    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs54j\" (UniqueName: \"kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j\") pod \"ai-gateway-controller-5f6dd4f69f-wn79w\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.481621 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.481588    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs\") pod \"ai-gateway-controller-5f6dd4f69f-wn79w\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.538105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.538037    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs54j\" (UniqueName: \"kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j\") pod \"ai-gateway-controller-5f6dd4f69f-wn79w\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") " pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:49.707288 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.707242    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68c46f9484-lpckr"]
Oct 31 00:25:49.714469 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:49.714442    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e3a1ea8_355d_4fe3_a7d9_388e908b80a4.slice/crio-e0d64c404ac85511c62bac4b67834502286486bdd32d09c5bf8ccd80a34eab80 WatchSource:0}: Error finding container e0d64c404ac85511c62bac4b67834502286486bdd32d09c5bf8ccd80a34eab80: Status 404 returned error can't find the container with id e0d64c404ac85511c62bac4b67834502286486bdd32d09c5bf8ccd80a34eab80
Oct 31 00:25:49.764550 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.764516    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c46f9484-lpckr" event={"ID":"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4","Type":"ContainerStarted","Data":"e0d64c404ac85511c62bac4b67834502286486bdd32d09c5bf8ccd80a34eab80"}
Oct 31 00:25:49.803817 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:49.803743    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:50.181781 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:50.181748    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"]
Oct 31 00:25:50.188065 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:25:50.188036    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfc64e4_5454_4167_97c1_c48ddbf3b498.slice/crio-09a0f547a49f186d136d4ae3aa6d6dba68a80a1205209f3f4cb8d19e83246793 WatchSource:0}: Error finding container 09a0f547a49f186d136d4ae3aa6d6dba68a80a1205209f3f4cb8d19e83246793: Status 404 returned error can't find the container with id 09a0f547a49f186d136d4ae3aa6d6dba68a80a1205209f3f4cb8d19e83246793
Oct 31 00:25:50.770459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:50.770409    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w" event={"ID":"4cfc64e4-5454-4167-97c1-c48ddbf3b498","Type":"ContainerStarted","Data":"09a0f547a49f186d136d4ae3aa6d6dba68a80a1205209f3f4cb8d19e83246793"}
Oct 31 00:25:51.778052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:51.778013    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68c46f9484-lpckr" event={"ID":"1e3a1ea8-355d-4fe3-a7d9-388e908b80a4","Type":"ContainerStarted","Data":"492dd35303f09988799f4e74af5511fad61f66bfb547851eef407e099cbb50aa"}
Oct 31 00:25:51.889653 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:51.889602    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-68c46f9484-lpckr" podStartSLOduration=2.285592806 podStartE2EDuration="3.889588514s" totalImagesPullingTime="1.603995708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:51.888133385 +0000 UTC m=+653.577013333" watchObservedRunningTime="2026-10-31 00:25:51.889588514 +0000 UTC m=+653.578468498"
Oct 31 00:25:51.939566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:51.939525    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6897f696b7-q2grc"]
Oct 31 00:25:51.939778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:51.939749    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6897f696b7-q2grc" podUID="dd346480-63cb-4e4d-9c6c-500ccf1af521" containerName="authorino" containerID="cri-o://41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04" gracePeriod=30
Oct 31 00:25:52.201942 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.201913    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:25:52.203680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.203648    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png\" (UniqueName: \"kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png\") pod \"dd346480-63cb-4e4d-9c6c-500ccf1af521\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") "
Oct 31 00:25:52.203762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.203700    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert\" (UniqueName: \"kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert\") pod \"dd346480-63cb-4e4d-9c6c-500ccf1af521\" (UID: \"dd346480-63cb-4e4d-9c6c-500ccf1af521\") "
Oct 31 00:25:52.205801 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.205770    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png" pod "dd346480-63cb-4e4d-9c6c-500ccf1af521" (UID: "dd346480-63cb-4e4d-9c6c-500ccf1af521"). InnerVolumeSpecName "kube-api-access-g6png". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:25:52.215803 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.215764    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert" pod "dd346480-63cb-4e4d-9c6c-500ccf1af521" (UID: "dd346480-63cb-4e4d-9c6c-500ccf1af521"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:25:52.305189 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.305149    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6png\" (UniqueName: \"kubernetes.io/projected/dd346480-63cb-4e4d-9c6c-500ccf1af521-kube-api-access-g6png\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:25:52.305189 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.305182    5925 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dd346480-63cb-4e4d-9c6c-500ccf1af521-tls-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:25:52.785485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.785382    5925 generic.go:356] "Generic (PLEG): container finished" podID="dd346480-63cb-4e4d-9c6c-500ccf1af521" containerID="41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04" exitCode=0
Oct 31 00:25:52.785485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.785445    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6897f696b7-q2grc" event={"ID":"dd346480-63cb-4e4d-9c6c-500ccf1af521","Type":"ContainerDied","Data":"41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04"}
Oct 31 00:25:52.785485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.785463    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6897f696b7-q2grc"
Oct 31 00:25:52.786037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.785488    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6897f696b7-q2grc" event={"ID":"dd346480-63cb-4e4d-9c6c-500ccf1af521","Type":"ContainerDied","Data":"973fa0051230a1f5b3b9bcabe5c020c9842ba6419a8f3204f2b1bf335cfcd8b9"}
Oct 31 00:25:52.786037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.785507    5925 scope.go:122] "RemoveContainer" containerID="41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04"
Oct 31 00:25:52.799559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.799531    5925 scope.go:122] "RemoveContainer" containerID="41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04"
Oct 31 00:25:52.799977 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:25:52.799954    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04\": container with ID starting with 41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04 not found: ID does not exist" containerID="41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04"
Oct 31 00:25:52.800067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.799987    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04"} err="failed to get container status \"41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04\": rpc error: code = NotFound desc = could not find container \"41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04\": container with ID starting with 41e436f32aad803c68945ed96fb945b6a27b96849623df76e2f29ff261b57a04 not found: ID does not exist"
Oct 31 00:25:52.947444 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.947392    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6897f696b7-q2grc"]
Oct 31 00:25:52.994852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:52.994820    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6897f696b7-q2grc"]
Oct 31 00:25:54.453081 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:54.453048    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd346480-63cb-4e4d-9c6c-500ccf1af521" path="/var/lib/kubelet/pods/dd346480-63cb-4e4d-9c6c-500ccf1af521/volumes"
Oct 31 00:25:56.814471 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:56.814434    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w" event={"ID":"4cfc64e4-5454-4167-97c1-c48ddbf3b498","Type":"ContainerStarted","Data":"7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0"}
Oct 31 00:25:56.814877 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:56.814499    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:25:56.927361 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:25:56.927308    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w" podStartSLOduration=2.247966115 podStartE2EDuration="7.92729503s" totalImagesPullingTime="5.679328915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:25:56.926167299 +0000 UTC m=+658.615047245" watchObservedRunningTime="2026-10-31 00:25:56.92729503 +0000 UTC m=+658.616174976"
Oct 31 00:26:00.116994 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.116958    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"]
Oct 31 00:26:00.117522 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.117464    5925 cpu_manager.go:414] "containerMap: removing container" podUID="dd346480-63cb-4e4d-9c6c-500ccf1af521" containerName="authorino"
Oct 31 00:26:00.117522 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.117480    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd346480-63cb-4e4d-9c6c-500ccf1af521" containerName="authorino"
Oct 31 00:26:00.117642 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.117625    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd346480-63cb-4e4d-9c6c-500ccf1af521" containerName="authorino"
Oct 31 00:26:00.122468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.122449    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.172452 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.172401    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Oct 31 00:26:00.191037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.190988    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjk9q\" (UniqueName: \"kubernetes.io/projected/96f3edec-f3b1-40e3-bc4c-3d15961274c8-kube-api-access-xjk9q\") pod \"payload-pre-processing-7b98bb678c-xhpxl\" (UID: \"96f3edec-f3b1-40e3-bc4c-3d15961274c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.191186 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.191127    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f3edec-f3b1-40e3-bc4c-3d15961274c8-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-xhpxl\" (UID: \"96f3edec-f3b1-40e3-bc4c-3d15961274c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.219810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.219778    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8222w\""
Oct 31 00:26:00.223373 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.223341    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"]
Oct 31 00:26:00.281011 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.280974    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-48lzq"]
Oct 31 00:26:00.285059 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.285037    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.292151 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.291738    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f3edec-f3b1-40e3-bc4c-3d15961274c8-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-xhpxl\" (UID: \"96f3edec-f3b1-40e3-bc4c-3d15961274c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.292151 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.291875    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjk9q\" (UniqueName: \"kubernetes.io/projected/96f3edec-f3b1-40e3-bc4c-3d15961274c8-kube-api-access-xjk9q\") pod \"payload-pre-processing-7b98bb678c-xhpxl\" (UID: \"96f3edec-f3b1-40e3-bc4c-3d15961274c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.292560 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.292540    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96f3edec-f3b1-40e3-bc4c-3d15961274c8-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-xhpxl\" (UID: \"96f3edec-f3b1-40e3-bc4c-3d15961274c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.342000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.341965    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-48lzq"]
Oct 31 00:26:00.351479 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.351450    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjk9q\" (UniqueName: \"kubernetes.io/projected/96f3edec-f3b1-40e3-bc4c-3d15961274c8-kube-api-access-xjk9q\") pod \"payload-pre-processing-7b98bb678c-xhpxl\" (UID: \"96f3edec-f3b1-40e3-bc4c-3d15961274c8\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.392601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.392515    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b16239d-fee3-4921-b7f3-42b62acceefb-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-48lzq\" (UID: \"2b16239d-fee3-4921-b7f3-42b62acceefb\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.392746 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.392671    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdj2\" (UniqueName: \"kubernetes.io/projected/2b16239d-fee3-4921-b7f3-42b62acceefb-kube-api-access-jtdj2\") pod \"payload-processing-55fbbbf9dc-48lzq\" (UID: \"2b16239d-fee3-4921-b7f3-42b62acceefb\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.435809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.435778    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:00.493961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.493711    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b16239d-fee3-4921-b7f3-42b62acceefb-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-48lzq\" (UID: \"2b16239d-fee3-4921-b7f3-42b62acceefb\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.493961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.493943    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdj2\" (UniqueName: \"kubernetes.io/projected/2b16239d-fee3-4921-b7f3-42b62acceefb-kube-api-access-jtdj2\") pod \"payload-processing-55fbbbf9dc-48lzq\" (UID: \"2b16239d-fee3-4921-b7f3-42b62acceefb\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.494811 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.494780    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b16239d-fee3-4921-b7f3-42b62acceefb-plugins-config-volume\") pod \"payload-processing-55fbbbf9dc-48lzq\" (UID: \"2b16239d-fee3-4921-b7f3-42b62acceefb\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.553561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.553526    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdj2\" (UniqueName: \"kubernetes.io/projected/2b16239d-fee3-4921-b7f3-42b62acceefb-kube-api-access-jtdj2\") pod \"payload-processing-55fbbbf9dc-48lzq\" (UID: \"2b16239d-fee3-4921-b7f3-42b62acceefb\") " pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.598318 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.598287    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:00.815667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.815637    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"]
Oct 31 00:26:00.821476 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:26:00.821450    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f3edec_f3b1_40e3_bc4c_3d15961274c8.slice/crio-d6e964cd69baa3fbb6dd737d0c660d65ece83f2f1a8c53288e40d1dc545ab40a WatchSource:0}: Error finding container d6e964cd69baa3fbb6dd737d0c660d65ece83f2f1a8c53288e40d1dc545ab40a: Status 404 returned error can't find the container with id d6e964cd69baa3fbb6dd737d0c660d65ece83f2f1a8c53288e40d1dc545ab40a
Oct 31 00:26:00.839546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.839513    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl" event={"ID":"96f3edec-f3b1-40e3-bc4c-3d15961274c8","Type":"ContainerStarted","Data":"d6e964cd69baa3fbb6dd737d0c660d65ece83f2f1a8c53288e40d1dc545ab40a"}
Oct 31 00:26:00.977784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:00.977705    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-55fbbbf9dc-48lzq"]
Oct 31 00:26:00.984068 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:26:00.984036    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b16239d_fee3_4921_b7f3_42b62acceefb.slice/crio-e195366ef5cd86c725e72aa9ba1bc1ed5decb6296075c0a5332395b515b33266 WatchSource:0}: Error finding container e195366ef5cd86c725e72aa9ba1bc1ed5decb6296075c0a5332395b515b33266: Status 404 returned error can't find the container with id e195366ef5cd86c725e72aa9ba1bc1ed5decb6296075c0a5332395b515b33266
Oct 31 00:26:01.848063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:01.848019    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq" event={"ID":"2b16239d-fee3-4921-b7f3-42b62acceefb","Type":"ContainerStarted","Data":"e195366ef5cd86c725e72aa9ba1bc1ed5decb6296075c0a5332395b515b33266"}
Oct 31 00:26:04.870489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:04.870446    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl" event={"ID":"96f3edec-f3b1-40e3-bc4c-3d15961274c8","Type":"ContainerStarted","Data":"6dcf10ca3b9203d73c17a7f842ab298208f5923dce713300c5fe1754870732f1"}
Oct 31 00:26:04.870996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:04.870649    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:04.872241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:04.872217    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq" event={"ID":"2b16239d-fee3-4921-b7f3-42b62acceefb","Type":"ContainerStarted","Data":"411c21c98095de6b2edc47f6d4acb1b54e30f190ce507e227b6fd8847dd3d87d"}
Oct 31 00:26:04.872369 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:04.872354    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:05.016614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:05.016554    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl" podStartSLOduration=1.5142850970000001 podStartE2EDuration="5.016540848s" totalImagesPullingTime="3.502255751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:26:05.016329909 +0000 UTC m=+666.705209855" watchObservedRunningTime="2026-10-31 00:26:05.016540848 +0000 UTC m=+666.705420794"
Oct 31 00:26:05.128893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:05.128780    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq" podStartSLOduration=1.939685653 podStartE2EDuration="5.128765631s" totalImagesPullingTime="3.189079978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:26:05.126875671 +0000 UTC m=+666.815755616" watchObservedRunningTime="2026-10-31 00:26:05.128765631 +0000 UTC m=+666.817645576"
Oct 31 00:26:07.824102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:07.824063    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:26:08.184204 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.184168    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-798c598657-7v952"]
Oct 31 00:26:08.187924 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.187904    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.246047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.246015    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-798c598657-7v952"]
Oct 31 00:26:08.274948 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.274919    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccaa72d-1270-45cf-a711-c97b7c58eb91-metrics-certs\") pod \"ai-gateway-controller-798c598657-7v952\" (UID: \"fccaa72d-1270-45cf-a711-c97b7c58eb91\") " pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.275127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.274965    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v97zb\" (UniqueName: \"kubernetes.io/projected/fccaa72d-1270-45cf-a711-c97b7c58eb91-kube-api-access-v97zb\") pod \"ai-gateway-controller-798c598657-7v952\" (UID: \"fccaa72d-1270-45cf-a711-c97b7c58eb91\") " pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.375888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.375855    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccaa72d-1270-45cf-a711-c97b7c58eb91-metrics-certs\") pod \"ai-gateway-controller-798c598657-7v952\" (UID: \"fccaa72d-1270-45cf-a711-c97b7c58eb91\") " pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.376076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.375915    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v97zb\" (UniqueName: \"kubernetes.io/projected/fccaa72d-1270-45cf-a711-c97b7c58eb91-kube-api-access-v97zb\") pod \"ai-gateway-controller-798c598657-7v952\" (UID: \"fccaa72d-1270-45cf-a711-c97b7c58eb91\") " pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.378299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.378276    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fccaa72d-1270-45cf-a711-c97b7c58eb91-metrics-certs\") pod \"ai-gateway-controller-798c598657-7v952\" (UID: \"fccaa72d-1270-45cf-a711-c97b7c58eb91\") " pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.435025 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.434953    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v97zb\" (UniqueName: \"kubernetes.io/projected/fccaa72d-1270-45cf-a711-c97b7c58eb91-kube-api-access-v97zb\") pod \"ai-gateway-controller-798c598657-7v952\" (UID: \"fccaa72d-1270-45cf-a711-c97b7c58eb91\") " pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.500573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.500541    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:08.873946 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.873906    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-798c598657-7v952"]
Oct 31 00:26:08.880092 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:26:08.880049    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfccaa72d_1270_45cf_a711_c97b7c58eb91.slice/crio-15d4eeb48525a8169db830e9698bf8871efdfeb3e81113a78e47ef61220d1224 WatchSource:0}: Error finding container 15d4eeb48525a8169db830e9698bf8871efdfeb3e81113a78e47ef61220d1224: Status 404 returned error can't find the container with id 15d4eeb48525a8169db830e9698bf8871efdfeb3e81113a78e47ef61220d1224
Oct 31 00:26:08.896339 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:08.896308    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-798c598657-7v952" event={"ID":"fccaa72d-1270-45cf-a711-c97b7c58eb91","Type":"ContainerStarted","Data":"15d4eeb48525a8169db830e9698bf8871efdfeb3e81113a78e47ef61220d1224"}
Oct 31 00:26:09.902863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:09.902815    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-798c598657-7v952" event={"ID":"fccaa72d-1270-45cf-a711-c97b7c58eb91","Type":"ContainerStarted","Data":"2fdb713be6851f9e9c54f20a8872e2a24916d85f8a6069e1b71746c5a704d65c"}
Oct 31 00:26:09.903270 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:09.902963    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:10.016465 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:10.016349    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-798c598657-7v952" podStartSLOduration=1.131156258 podStartE2EDuration="2.016335299s" totalImagesPullingTime="885.179041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:26:10.013919591 +0000 UTC m=+671.702799537" watchObservedRunningTime="2026-10-31 00:26:10.016335299 +0000 UTC m=+671.705215245"
Oct 31 00:26:15.882797 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:15.882765    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-55fbbbf9dc-48lzq"
Oct 31 00:26:15.883298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:15.882850    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-xhpxl"
Oct 31 00:26:16.543031 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:26:16.542993    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:26:20.910776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:20.910747    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-798c598657-7v952"
Oct 31 00:26:21.073638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.073607    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"]
Oct 31 00:26:21.073883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.073857    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w" podUID="4cfc64e4-5454-4167-97c1-c48ddbf3b498" containerName="manager" containerID="cri-o://7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0" gracePeriod=30
Oct 31 00:26:21.335383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.335355    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:26:21.403709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.403683    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs\") pod \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") "
Oct 31 00:26:21.403842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.403795    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j\" (UniqueName: \"kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j\") pod \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\" (UID: \"4cfc64e4-5454-4167-97c1-c48ddbf3b498\") "
Oct 31 00:26:21.405741 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.405711    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs" pod "4cfc64e4-5454-4167-97c1-c48ddbf3b498" (UID: "4cfc64e4-5454-4167-97c1-c48ddbf3b498"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:26:21.405842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.405762    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j" pod "4cfc64e4-5454-4167-97c1-c48ddbf3b498" (UID: "4cfc64e4-5454-4167-97c1-c48ddbf3b498"). InnerVolumeSpecName "kube-api-access-rs54j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:26:21.504713 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.504636    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cfc64e4-5454-4167-97c1-c48ddbf3b498-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:26:21.504713 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.504664    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs54j\" (UniqueName: \"kubernetes.io/projected/4cfc64e4-5454-4167-97c1-c48ddbf3b498-kube-api-access-rs54j\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:26:21.968353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.968322    5925 generic.go:356] "Generic (PLEG): container finished" podID="4cfc64e4-5454-4167-97c1-c48ddbf3b498" containerID="7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0" exitCode=0
Oct 31 00:26:21.968353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.968357    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w" event={"ID":"4cfc64e4-5454-4167-97c1-c48ddbf3b498","Type":"ContainerDied","Data":"7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0"}
Oct 31 00:26:21.968847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.968367    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"
Oct 31 00:26:21.968847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.968396    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w" event={"ID":"4cfc64e4-5454-4167-97c1-c48ddbf3b498","Type":"ContainerDied","Data":"09a0f547a49f186d136d4ae3aa6d6dba68a80a1205209f3f4cb8d19e83246793"}
Oct 31 00:26:21.968847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.968429    5925 scope.go:122] "RemoveContainer" containerID="7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0"
Oct 31 00:26:21.978967 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.978946    5925 scope.go:122] "RemoveContainer" containerID="7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0"
Oct 31 00:26:21.979224 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:26:21.979202    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0\": container with ID starting with 7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0 not found: ID does not exist" containerID="7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0"
Oct 31 00:26:21.979269 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:21.979233    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0"} err="failed to get container status \"7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0\": rpc error: code = NotFound desc = could not find container \"7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0\": container with ID starting with 7403b00393b72162ab382003982e43bdcacf43f6098624552ec23cdb5c3e20e0 not found: ID does not exist"
Oct 31 00:26:22.128687 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:22.128655    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"]
Oct 31 00:26:22.175090 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:22.175054    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5f6dd4f69f-wn79w"]
Oct 31 00:26:22.451496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:22.451468    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4cfc64e4-5454-4167-97c1-c48ddbf3b498" path="/var/lib/kubelet/pods/4cfc64e4-5454-4167-97c1-c48ddbf3b498/volumes"
Oct 31 00:26:46.542513 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:26:46.542478    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:26:52.833899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.833865    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"]
Oct 31 00:26:52.834404 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.834369    5925 cpu_manager.go:414] "containerMap: removing container" podUID="4cfc64e4-5454-4167-97c1-c48ddbf3b498" containerName="manager"
Oct 31 00:26:52.834404 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.834384    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4cfc64e4-5454-4167-97c1-c48ddbf3b498" containerName="manager"
Oct 31 00:26:52.834652 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.834634    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="4cfc64e4-5454-4167-97c1-c48ddbf3b498" containerName="manager"
Oct 31 00:26:52.838108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.838089    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.911771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.911734    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h54t2\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.911950 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.911805    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.911950 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.911894    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.911950 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.911938    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.912089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.912001    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.912089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.912042    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.912172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.912145    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.912210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.912193    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.912319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.912303    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:52.936372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.936341    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-a6f4a5-openshift-default-dockercfg-r4d7m\""
Oct 31 00:26:52.938707 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:52.938672    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"]
Oct 31 00:26:53.013673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013630    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.013880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013681    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h54t2\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.013880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013722    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.013880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013756    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.013880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013796    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.013880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013829    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013884    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013934    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.013966    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.014108    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.014118    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014457 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.014333    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014504 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.014453    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.014608 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.014588    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.016145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.016122    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.016295 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.016275    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.072856 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.072822    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.073153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.073104    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h54t2\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.151177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.151095    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:53.490388 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.490296    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"]
Oct 31 00:26:53.495306 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.495283    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.550696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.550631    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-da9d07-openshift-default-dockercfg-ckgpr\""
Oct 31 00:26:53.551808 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.551777    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"]
Oct 31 00:26:53.620618 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620576    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsb2g\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620618 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620622    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620722    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620767    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620788    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620860    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620891    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.620922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620917    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.621014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.620941    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.634735 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.634697    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"]
Oct 31 00:26:53.643462 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:26:53.643409    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad041db5_19f1_4bf7_8bac_917af1adebea.slice/crio-c95ea9bffbeb2604d96814fdc787a5bbb5243ef75c16fb3f3824e589d0612a17 WatchSource:0}: Error finding container c95ea9bffbeb2604d96814fdc787a5bbb5243ef75c16fb3f3824e589d0612a17: Status 404 returned error can't find the container with id c95ea9bffbeb2604d96814fdc787a5bbb5243ef75c16fb3f3824e589d0612a17
Oct 31 00:26:53.645569 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.645529    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:53.645689 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.645616    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:53.645689 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.645658    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:53.721671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721635    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsb2g\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.721855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721687    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.721855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721735    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.721855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721786    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.721855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721816    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721867    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721907    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721949    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.721982    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.722217    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722779 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.722679    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722779 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.722739    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.722962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.722890    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.723027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.723005    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.724386 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.724366    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.724761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.724731    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.780495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.780374    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsb2g\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.780665 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.780536    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:53.809267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:53.809224    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:54.149847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.149810    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" event={"ID":"ad041db5-19f1-4bf7-8bac-917af1adebea","Type":"ContainerStarted","Data":"ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"}
Oct 31 00:26:54.150257 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.149876    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" event={"ID":"ad041db5-19f1-4bf7-8bac-917af1adebea","Type":"ContainerStarted","Data":"c95ea9bffbeb2604d96814fdc787a5bbb5243ef75c16fb3f3824e589d0612a17"}
Oct 31 00:26:54.152168 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.152147    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:54.157512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.157490    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:54.269431 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.269391    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"]
Oct 31 00:26:54.276449 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:26:54.276404    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63edbbb4_ebe7_4e1e_add9_9689b2bb365e.slice/crio-bae664f6e3fe7d9be07ae9cc78d83ff669ab184e040c45ebdef7abd4534c3349 WatchSource:0}: Error finding container bae664f6e3fe7d9be07ae9cc78d83ff669ab184e040c45ebdef7abd4534c3349: Status 404 returned error can't find the container with id bae664f6e3fe7d9be07ae9cc78d83ff669ab184e040c45ebdef7abd4534c3349
Oct 31 00:26:54.278759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.278730    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:54.278858 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.278793    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:54.278858 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.278823    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:54.301562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.301516    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podStartSLOduration=2.301498188 podStartE2EDuration="2.301498188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:26:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:26:54.300488356 +0000 UTC m=+715.989368303" watchObservedRunningTime="2026-10-31 00:26:54.301498188 +0000 UTC m=+715.990378134"
Oct 31 00:26:54.576976 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.576895    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"]
Oct 31 00:26:54.581458 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.581433    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.631786 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.631748    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-412743-openshift-default-dockercfg-wqjw6\""
Oct 31 00:26:54.650064 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.650032    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"]
Oct 31 00:26:54.732252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732211    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732262    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732394    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732452    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89577\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732523    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732590    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732625    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732679    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.732957 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.732709    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834118    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834331 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834177    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834331 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834210    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834331 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834297    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834331 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834320    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834353    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834383    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89577\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834487    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834549    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834902 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834865    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834902    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.834983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.834932    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.835090 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.835003    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.835124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.835084    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.836579 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.836554    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.836698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.836681    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.892865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.892835    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.893260 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.892916    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89577\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:54.895750 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:54.895729    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:55.157162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.157077    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" event={"ID":"63edbbb4-ebe7-4e1e-add9-9689b2bb365e","Type":"ContainerStarted","Data":"fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"}
Oct 31 00:26:55.157162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.157144    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" event={"ID":"63edbbb4-ebe7-4e1e-add9-9689b2bb365e","Type":"ContainerStarted","Data":"bae664f6e3fe7d9be07ae9cc78d83ff669ab184e040c45ebdef7abd4534c3349"}
Oct 31 00:26:55.157613 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.157335    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:55.158196 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.158177    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:26:55.276615 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.276551    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podStartSLOduration=2.276535974 podStartE2EDuration="2.276535974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:26:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:26:55.27472574 +0000 UTC m=+716.963605722" watchObservedRunningTime="2026-10-31 00:26:55.276535974 +0000 UTC m=+716.965415920"
Oct 31 00:26:55.325474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.325433    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"]
Oct 31 00:26:55.331614 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:26:55.331583    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37aa8b1_450e_4dfd_965e_29b11ccaad9c.slice/crio-8fb2cedeee983040269b7b432476c5182a97ce8d04a74503894206350ef3a54f WatchSource:0}: Error finding container 8fb2cedeee983040269b7b432476c5182a97ce8d04a74503894206350ef3a54f: Status 404 returned error can't find the container with id 8fb2cedeee983040269b7b432476c5182a97ce8d04a74503894206350ef3a54f
Oct 31 00:26:55.334025 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.333995    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:55.334111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.334060    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:55.334111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.334087    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:26:55.809830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.809749    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:55.815203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:55.815181    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:56.164631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.164593    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" event={"ID":"c37aa8b1-450e-4dfd-965e-29b11ccaad9c","Type":"ContainerStarted","Data":"7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"}
Oct 31 00:26:56.165105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.164652    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" event={"ID":"c37aa8b1-450e-4dfd-965e-29b11ccaad9c","Type":"ContainerStarted","Data":"8fb2cedeee983040269b7b432476c5182a97ce8d04a74503894206350ef3a54f"}
Oct 31 00:26:56.165105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.165083    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:56.165999 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.165983    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:26:56.282246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.282193    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podStartSLOduration=2.282180975 podStartE2EDuration="2.282180975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:26:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:26:56.280812909 +0000 UTC m=+717.969692861" watchObservedRunningTime="2026-10-31 00:26:56.282180975 +0000 UTC m=+717.971060988"
Oct 31 00:26:56.896588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.896548    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:56.901954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:56.901925    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:57.171037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:57.170949    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:26:57.171521 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:26:57.171503    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:27:03.722920 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.722888    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"]
Oct 31 00:27:03.728488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.728467    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.779146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.779107    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-1e5e75-serving-cert\""
Oct 31 00:27:03.828426 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.828389    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"]
Oct 31 00:27:03.843906 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.843872    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77wm8\" (UniqueName: \"kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.844089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.843941    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.844089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.844066    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.844170 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.844149    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.945325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.945286    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.945553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.945376    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.945553 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:03.945491    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-serving-cert: secret "maas-api-e2e-worker-w3-1e5e75-serving-cert" not found
Oct 31 00:27:03.945553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.945511    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77wm8\" (UniqueName: \"kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.945553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.945539    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.945777 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:03.945586    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls podName:cdffdf92-1a6e-4f0e-8046-a8459e04262c nodeName:}" failed. No retries permitted until 2026-10-31 00:27:04.445561779 +0000 UTC m=+726.134441722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls") pod "maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" (UID: "cdffdf92-1a6e-4f0e-8046-a8459e04262c") : secret "maas-api-e2e-worker-w3-1e5e75-serving-cert" not found
Oct 31 00:27:03.946176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.946157    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:03.947945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:03.947929    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:04.014188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:04.014108    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77wm8\" (UniqueName: \"kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:04.451502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:04.451466    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:04.453866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:04.453842    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:04.642043 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:04.642004    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:05.016255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:05.016220    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"]
Oct 31 00:27:05.022684 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:27:05.022655    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdffdf92_1a6e_4f0e_8046_a8459e04262c.slice/crio-938d624c31f764c2fa4ea546788d97ff40e7ab0aec96500ba88c7b076210519f WatchSource:0}: Error finding container 938d624c31f764c2fa4ea546788d97ff40e7ab0aec96500ba88c7b076210519f: Status 404 returned error can't find the container with id 938d624c31f764c2fa4ea546788d97ff40e7ab0aec96500ba88c7b076210519f
Oct 31 00:27:05.223727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:05.223694    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" event={"ID":"cdffdf92-1a6e-4f0e-8046-a8459e04262c","Type":"ContainerStarted","Data":"938d624c31f764c2fa4ea546788d97ff40e7ab0aec96500ba88c7b076210519f"}
Oct 31 00:27:06.231288 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:06.231250    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" event={"ID":"cdffdf92-1a6e-4f0e-8046-a8459e04262c","Type":"ContainerStarted","Data":"2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352"}
Oct 31 00:27:06.231724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:06.231313    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:06.395355 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:06.395298    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" podStartSLOduration=2.423486965 podStartE2EDuration="3.395284809s" totalImagesPullingTime="971.797844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:27:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:27:06.394758858 +0000 UTC m=+728.083638804" watchObservedRunningTime="2026-10-31 00:27:06.395284809 +0000 UTC m=+728.084164779"
Oct 31 00:27:12.268436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:12.263618    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:27:14.171591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.171550    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"]
Oct 31 00:27:14.176215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.176191    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.228561 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.228518    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"]
Oct 31 00:27:14.272038 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.272008    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-982ae3\""
Oct 31 00:27:14.272038 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.272029    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-982ae3-dockercfg-jxrpp\""
Oct 31 00:27:14.278554 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.278525    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.278711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.278696    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkzf6\" (UniqueName: \"kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6\") pod \"payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.379409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.379372    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkzf6\" (UniqueName: \"kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6\") pod \"payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.379620 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.379458    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.380203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.380174    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.438563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.438490    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkzf6\" (UniqueName: \"kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6\") pod \"payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.489282 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.489242    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:14.706564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.706478    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"]
Oct 31 00:27:14.710553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.710530    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.762125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.762089    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-982ae3-serving-cert\""
Oct 31 00:27:14.765727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.765692    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"]
Oct 31 00:27:14.783899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.783858    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.784102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.783997    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.784102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.784068    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5lnf\" (UniqueName: \"kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.784201 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.784182    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.880581 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.880548    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"]
Oct 31 00:27:14.885564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.885537    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5lnf\" (UniqueName: \"kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.885707 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.885611    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.885769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.885748    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.885828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.885805    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.885959 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:14.885941    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-serving-cert: secret "maas-api-e2e-worker-w1-982ae3-serving-cert" not found
Oct 31 00:27:14.886036 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:14.886023    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls podName:53115e5a-28f7-4c96-b827-8092d92e5c4d nodeName:}" failed. No retries permitted until 2026-10-31 00:27:15.386000993 +0000 UTC m=+737.074880932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls") pod "maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" (UID: "53115e5a-28f7-4c96-b827-8092d92e5c4d") : secret "maas-api-e2e-worker-w1-982ae3-serving-cert" not found
Oct 31 00:27:14.886467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.886387    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.887915 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:27:14.887890    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9885498_ddf0_499e_b943_6ada0b147c8f.slice/crio-c22c44b21c2c8da4abf287076734ad14960cf9ce682f1bb7c89eee30a319bf15 WatchSource:0}: Error finding container c22c44b21c2c8da4abf287076734ad14960cf9ce682f1bb7c89eee30a319bf15: Status 404 returned error can't find the container with id c22c44b21c2c8da4abf287076734ad14960cf9ce682f1bb7c89eee30a319bf15
Oct 31 00:27:14.888849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.888796    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:14.946396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:14.946353    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5lnf\" (UniqueName: \"kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:15.304574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.304535    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx" event={"ID":"c9885498-ddf0-499e-b943-6ada0b147c8f","Type":"ContainerStarted","Data":"bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d"}
Oct 31 00:27:15.304987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.304606    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx" event={"ID":"c9885498-ddf0-499e-b943-6ada0b147c8f","Type":"ContainerStarted","Data":"c22c44b21c2c8da4abf287076734ad14960cf9ce682f1bb7c89eee30a319bf15"}
Oct 31 00:27:15.304987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.304693    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:15.391199 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.391156    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:15.393650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.393624    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\") pod \"maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:15.420599 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.420539    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx" podStartSLOduration=1.420524968 podStartE2EDuration="1.420524968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:27:15.418380077 +0000 UTC m=+737.107260023" watchObservedRunningTime="2026-10-31 00:27:15.420524968 +0000 UTC m=+737.109404914"
Oct 31 00:27:15.625228 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:15.625195    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:16.000930 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:16.000836    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"]
Oct 31 00:27:16.006672 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:27:16.006633    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53115e5a_28f7_4c96_b827_8092d92e5c4d.slice/crio-1fa69d59c18712435a789cfc35c423a6439972d0153391762cb53435e018eceb WatchSource:0}: Error finding container 1fa69d59c18712435a789cfc35c423a6439972d0153391762cb53435e018eceb: Status 404 returned error can't find the container with id 1fa69d59c18712435a789cfc35c423a6439972d0153391762cb53435e018eceb
Oct 31 00:27:16.337154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:16.337111    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" event={"ID":"53115e5a-28f7-4c96-b827-8092d92e5c4d","Type":"ContainerStarted","Data":"1fa69d59c18712435a789cfc35c423a6439972d0153391762cb53435e018eceb"}
Oct 31 00:27:16.545403 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:16.545363    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:27:17.345088 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:17.345045    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" event={"ID":"53115e5a-28f7-4c96-b827-8092d92e5c4d","Type":"ContainerStarted","Data":"558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4"}
Oct 31 00:27:17.345593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:17.345117    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:17.458142 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:17.458091    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" podStartSLOduration=2.6108781089999997 podStartE2EDuration="3.458077925s" totalImagesPullingTime="847.199816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:27:17.458030598 +0000 UTC m=+739.146910543" watchObservedRunningTime="2026-10-31 00:27:17.458077925 +0000 UTC m=+739.146957872"
Oct 31 00:27:23.374058 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:23.374015    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:27:25.768483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.768370    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"]
Oct 31 00:27:25.772662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.772641    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:25.819240 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.819208    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"]
Oct 31 00:27:25.870696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.870663    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-e8ba06-serving-cert\""
Oct 31 00:27:25.915986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.915693    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdwz\" (UniqueName: \"kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:25.915986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.915739    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:25.915986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.915774    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:25.915986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:25.915823    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.017254 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.017214    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdwz\" (UniqueName: \"kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.017476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.017264    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.017476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.017314    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.017476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.017382    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.018212 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.018186    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.020002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.019957    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.020668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.020645    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.076887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.076842    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdwz\" (UniqueName: \"kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz\") pod \"maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.087161 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.087129    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:26.365858 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.365828    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:27:26.496086 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:27:26.496041    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb942fc86_881c_413d_87a7_b33d47978233.slice/crio-f41d22937f5e16a438f036f8414aed0bb9627507222a6e2b751fec8715106919 WatchSource:0}: Error finding container f41d22937f5e16a438f036f8414aed0bb9627507222a6e2b751fec8715106919: Status 404 returned error can't find the container with id f41d22937f5e16a438f036f8414aed0bb9627507222a6e2b751fec8715106919
Oct 31 00:27:26.534887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:26.534851    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"]
Oct 31 00:27:27.414481 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:27.414442    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc" event={"ID":"b942fc86-881c-413d-87a7-b33d47978233","Type":"ContainerStarted","Data":"f41d22937f5e16a438f036f8414aed0bb9627507222a6e2b751fec8715106919"}
Oct 31 00:27:28.424060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:28.424020    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc" event={"ID":"b942fc86-881c-413d-87a7-b33d47978233","Type":"ContainerStarted","Data":"e5b60bc5828c8191d05d085f35d923cddcb582e8678130cbb184d67308cf6a14"}
Oct 31 00:27:28.424901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:28.424876    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:28.544785 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:28.544724    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc" podStartSLOduration=2.483070445 podStartE2EDuration="3.54470962s" totalImagesPullingTime="1.061639175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:27:28.542716455 +0000 UTC m=+750.231596403" watchObservedRunningTime="2026-10-31 00:27:28.54470962 +0000 UTC m=+750.233589565"
Oct 31 00:27:31.446328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:31.446295    5925 generic.go:356] "Generic (PLEG): container finished" podID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerID="ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5" exitCode=0
Oct 31 00:27:31.446810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:31.446371    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" event={"ID":"ad041db5-19f1-4bf7-8bac-917af1adebea","Type":"ContainerDied","Data":"ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"}
Oct 31 00:27:31.446810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:31.446773    5925 scope.go:122] "RemoveContainer" containerID="ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"
Oct 31 00:27:31.448121 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:31.448088    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:27:31.448230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:31.448173    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:27:31.448230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:31.448223    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:27:32.473785 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:32.473748    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" event={"ID":"ad041db5-19f1-4bf7-8bac-917af1adebea","Type":"ContainerStarted","Data":"0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060"}
Oct 31 00:27:33.156440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:33.154813    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:27:33.156440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:33.154949    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:27:33.156440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:33.154993    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 31 00:27:34.164828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:34.164787    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:27:34.165225 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:34.164864    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 31 00:27:35.153438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:35.151856    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:27:35.153438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:35.151926    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 31 00:27:35.464500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:35.463653    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:27:36.168441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:36.162152    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:27:36.168441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:36.162219    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 31 00:27:37.161506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:37.161468    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:27:37.162145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:37.162113    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 31 00:27:38.156455 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:38.156387    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:27:38.156898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:38.156875    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:27:38.157761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:38.157737    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:27:46.545432 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:46.545377    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:27:47.333397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.333359    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"]
Oct 31 00:27:47.336650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.336627    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.389469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.389438    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-412743-serving-cert\""
Oct 31 00:27:47.423966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.423927    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.423966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.423973    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f844\" (UniqueName: \"kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.424199 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.424169    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.424245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.424225    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.439868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.439829    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"]
Oct 31 00:27:47.525053 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.525009    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.525256 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.525058    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.525256 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.525192    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.525256 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.525222    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f844\" (UniqueName: \"kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.525450 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:47.525336    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-serving-cert: secret "maas-api-e2e-worker-w5-412743-serving-cert" not found
Oct 31 00:27:47.525450 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:27:47.525445    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls podName:60d3080b-6e9e-4f19-b5dc-adcbcda41402 nodeName:}" failed. No retries permitted until 2026-10-31 00:27:48.025407106 +0000 UTC m=+769.714287031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls") pod "maas-api-e2e-worker-w5-412743-866454db65-rtd6j" (UID: "60d3080b-6e9e-4f19-b5dc-adcbcda41402") : secret "maas-api-e2e-worker-w5-412743-serving-cert" not found
Oct 31 00:27:47.525898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.525875    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.527948 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.527924    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:47.593303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:47.593218    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f844\" (UniqueName: \"kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:48.031172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:48.031076    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:48.033598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:48.033571    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\") pod \"maas-api-e2e-worker-w5-412743-866454db65-rtd6j\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:48.257977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:48.257639    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:48.658439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:48.658110    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"]
Oct 31 00:27:49.610868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:49.610830    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j" event={"ID":"60d3080b-6e9e-4f19-b5dc-adcbcda41402","Type":"ContainerStarted","Data":"01d3076ff4935653d437df49eb5ae25b364eb3e6a47e2c763ad00e43206ac9eb"}
Oct 31 00:27:50.618102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:50.618067    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j" event={"ID":"60d3080b-6e9e-4f19-b5dc-adcbcda41402","Type":"ContainerStarted","Data":"f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2"}
Oct 31 00:27:50.618535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:50.618127    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:50.736600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:50.736541    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j" podStartSLOduration=2.837305683 podStartE2EDuration="3.73652659s" totalImagesPullingTime="899.220907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:27:50.736106997 +0000 UTC m=+772.424986944" watchObservedRunningTime="2026-10-31 00:27:50.73652659 +0000 UTC m=+772.425406535"
Oct 31 00:27:56.509802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.509235    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:56690->10.132.0.68:15021: read: connection reset by peer" start-of-body=
Oct 31 00:27:56.509802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.509336    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": read tcp 10.132.0.2:56690->10.132.0.68:15021: read: connection reset by peer"
Oct 31 00:27:56.631436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.631387    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:27:56.664731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.664699    5925 generic.go:356] "Generic (PLEG): container finished" podID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerID="fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8" exitCode=0
Oct 31 00:27:56.664927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.664774    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" event={"ID":"63edbbb4-ebe7-4e1e-add9-9689b2bb365e","Type":"ContainerDied","Data":"fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"}
Oct 31 00:27:56.665211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.665194    5925 scope.go:122] "RemoveContainer" containerID="fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"
Oct 31 00:27:56.666814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.666784    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:27:56.666899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.666875    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:27:56.666938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:56.666925    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:27:57.690381 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:57.690346    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" event={"ID":"63edbbb4-ebe7-4e1e-add9-9689b2bb365e","Type":"ContainerStarted","Data":"faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e"}
Oct 31 00:27:57.809791 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:57.809757    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:27:57.810072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:57.810044    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:27:57.810117 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:57.810100    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 31 00:27:58.809864 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:58.809822    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:27:58.810463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:58.809885    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 31 00:27:59.809837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:59.809798    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:27:59.810023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:27:59.809860    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 31 00:28:00.809791 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:00.809732    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:28:00.809984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:00.809806    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 31 00:28:01.809800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:01.809756    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:28:01.810231 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:01.809818    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 31 00:28:02.809861 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:02.809824    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:28:02.810236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:02.809893    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 31 00:28:03.813919 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:03.813887    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:28:03.814368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:03.814199    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:28:03.814868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:03.814848    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:28:06.767098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:06.767062    5925 generic.go:356] "Generic (PLEG): container finished" podID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerID="7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73" exitCode=0
Oct 31 00:28:06.767589 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:06.767135    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" event={"ID":"c37aa8b1-450e-4dfd-965e-29b11ccaad9c","Type":"ContainerDied","Data":"7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"}
Oct 31 00:28:06.767634 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:06.767608    5925 scope.go:122] "RemoveContainer" containerID="7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"
Oct 31 00:28:06.769086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:06.769059    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:28:06.769158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:06.769134    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:28:06.769196 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:06.769168    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:28:07.776362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:07.776327    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" event={"ID":"c37aa8b1-450e-4dfd-965e-29b11ccaad9c","Type":"ContainerStarted","Data":"19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728"}
Oct 31 00:28:07.896015 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:07.895977    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:28:07.897454 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:07.897408    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:28:07.897604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:07.897501    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 31 00:28:08.896359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:08.896319    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:28:08.896829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:08.896374    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 31 00:28:09.896262 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:09.896222    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:28:09.896520 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:09.896294    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 31 00:28:10.896292 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:10.896252    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:28:10.896510 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:10.896323    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 31 00:28:11.896494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:11.896452    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:28:11.896909 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:11.896530    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 31 00:28:12.170800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:12.170720    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:28:12.896286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:12.896239    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:28:12.896503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:12.896318    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 31 00:28:13.901240 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:13.901205    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:28:13.902400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:28:13.902377    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:28:16.544568 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:28:16.544527    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:28:46.542736 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:28:46.542698    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:29:16.542513 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:29:16.542473    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:29:46.544501 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:29:46.544459    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:29:58.597821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:29:58.597791    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:29:58.599452 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:29:58.599427    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:30:00.248548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.248513    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"]
Oct 31 00:30:00.251603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.251584    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.308999 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.308964    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"]
Oct 31 00:30:00.316221 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.316192    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.316391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.316370    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l58pn\" (UniqueName: \"kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn\") pod \"maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.359499 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.359463    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zfz9z\""
Oct 31 00:30:00.417641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.417602    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.417829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.417712    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l58pn\" (UniqueName: \"kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn\") pod \"maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.418265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.418242    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.478504 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.478471    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l58pn\" (UniqueName: \"kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn\") pod \"maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.564094 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.564014    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:00.939372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:00.939339    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"]
Oct 31 00:30:00.945699 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:30:00.945653    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112ea309_548a_45a4_8f02_a30b8ca3e3c7.slice/crio-bbb2ee6216b4afa0bf4080e688d7c2ea646b3820cb1403403bb611e0af054707 WatchSource:0}: Error finding container bbb2ee6216b4afa0bf4080e688d7c2ea646b3820cb1403403bb611e0af054707: Status 404 returned error can't find the container with id bbb2ee6216b4afa0bf4080e688d7c2ea646b3820cb1403403bb611e0af054707
Oct 31 00:30:01.525255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:01.525214    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" event={"ID":"112ea309-548a-45a4-8f02-a30b8ca3e3c7","Type":"ContainerStarted","Data":"bbb2ee6216b4afa0bf4080e688d7c2ea646b3820cb1403403bb611e0af054707"}
Oct 31 00:30:06.564156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:06.564062    5925 generic.go:356] "Generic (PLEG): container finished" podID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerID="98671ab5fbefc9ddd2e5f17c4c22a2bf2a1ca087d9990d1350693635cd813a11" exitCode=60
Oct 31 00:30:06.564156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:06.564145    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" event={"ID":"112ea309-548a-45a4-8f02-a30b8ca3e3c7","Type":"ContainerDied","Data":"98671ab5fbefc9ddd2e5f17c4c22a2bf2a1ca087d9990d1350693635cd813a11"}
Oct 31 00:30:06.564745 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:06.564538    5925 scope.go:122] "RemoveContainer" containerID="98671ab5fbefc9ddd2e5f17c4c22a2bf2a1ca087d9990d1350693635cd813a11"
Oct 31 00:30:07.573189 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:07.573156    5925 generic.go:356] "Generic (PLEG): container finished" podID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerID="65b787e098961796daa30c246343f08168b663a0d297ad19f76e9696a2acce8d" exitCode=60
Oct 31 00:30:07.573672 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:07.573248    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" event={"ID":"112ea309-548a-45a4-8f02-a30b8ca3e3c7","Type":"ContainerDied","Data":"65b787e098961796daa30c246343f08168b663a0d297ad19f76e9696a2acce8d"}
Oct 31 00:30:07.573672 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:07.573317    5925 scope.go:122] "RemoveContainer" containerID="98671ab5fbefc9ddd2e5f17c4c22a2bf2a1ca087d9990d1350693635cd813a11"
Oct 31 00:30:07.573672 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:07.573621    5925 scope.go:122] "RemoveContainer" containerID="65b787e098961796daa30c246343f08168b663a0d297ad19f76e9696a2acce8d"
Oct 31 00:30:07.573926 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:30:07.573902    5925 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt_odh-ai-gateway-infra(112ea309-548a-45a4-8f02-a30b8ca3e3c7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7"
Oct 31 00:30:08.583631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:08.583598    5925 scope.go:122] "RemoveContainer" containerID="65b787e098961796daa30c246343f08168b663a0d297ad19f76e9696a2acce8d"
Oct 31 00:30:08.584033 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:30:08.583935    5925 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt_odh-ai-gateway-infra(112ea309-548a-45a4-8f02-a30b8ca3e3c7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7"
Oct 31 00:30:16.543398 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:30:16.543365    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:30:21.448116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:21.445266    5925 scope.go:122] "RemoveContainer" containerID="65b787e098961796daa30c246343f08168b663a0d297ad19f76e9696a2acce8d"
Oct 31 00:30:22.674382 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:22.674348    5925 generic.go:356] "Generic (PLEG): container finished" podID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerID="662fcfc9d5c8823bbb2a4852c4d8811f160c2110250e2ccef65fedf622b9ae20" exitCode=60
Oct 31 00:30:22.674850 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:22.674450    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" event={"ID":"112ea309-548a-45a4-8f02-a30b8ca3e3c7","Type":"ContainerDied","Data":"662fcfc9d5c8823bbb2a4852c4d8811f160c2110250e2ccef65fedf622b9ae20"}
Oct 31 00:30:22.674850 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:22.674515    5925 scope.go:122] "RemoveContainer" containerID="65b787e098961796daa30c246343f08168b663a0d297ad19f76e9696a2acce8d"
Oct 31 00:30:22.674952 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:22.674922    5925 scope.go:122] "RemoveContainer" containerID="662fcfc9d5c8823bbb2a4852c4d8811f160c2110250e2ccef65fedf622b9ae20"
Oct 31 00:30:22.675209 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:30:22.675184    5925 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt_odh-ai-gateway-infra(112ea309-548a-45a4-8f02-a30b8ca3e3c7)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7"
Oct 31 00:30:23.796078 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:23.796045    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"]
Oct 31 00:30:23.950349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:23.950324    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:24.088130 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.088103    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn\" (UniqueName: \"kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn\") pod \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") "
Oct 31 00:30:24.088297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.088167    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca\") pod \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\" (UID: \"112ea309-548a-45a4-8f02-a30b8ca3e3c7\") "
Oct 31 00:30:24.088612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.088583    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca" pod "112ea309-548a-45a4-8f02-a30b8ca3e3c7" (UID: "112ea309-548a-45a4-8f02-a30b8ca3e3c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:30:24.090444 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.090389    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn" pod "112ea309-548a-45a4-8f02-a30b8ca3e3c7" (UID: "112ea309-548a-45a4-8f02-a30b8ca3e3c7"). InnerVolumeSpecName "kube-api-access-l58pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:30:24.189714 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.189676    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l58pn\" (UniqueName: \"kubernetes.io/projected/112ea309-548a-45a4-8f02-a30b8ca3e3c7-kube-api-access-l58pn\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:24.189714 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.189708    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/112ea309-548a-45a4-8f02-a30b8ca3e3c7-maas-api-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:30:24.695042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.695006    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt" event={"ID":"112ea309-548a-45a4-8f02-a30b8ca3e3c7","Type":"ContainerDied","Data":"bbb2ee6216b4afa0bf4080e688d7c2ea646b3820cb1403403bb611e0af054707"}
Oct 31 00:30:24.695042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.695031    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"
Oct 31 00:30:24.695298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.695069    5925 scope.go:122] "RemoveContainer" containerID="662fcfc9d5c8823bbb2a4852c4d8811f160c2110250e2ccef65fedf622b9ae20"
Oct 31 00:30:24.852948 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.852918    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"]
Oct 31 00:30:24.900622 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:24.900585    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-982ae3-29890110-p2rzt"]
Oct 31 00:30:26.456943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:30:26.456899    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" path="/var/lib/kubelet/pods/112ea309-548a-45a4-8f02-a30b8ca3e3c7/volumes"
Oct 31 00:30:46.543207 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:30:46.543166    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:31:16.551686 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:31:16.551648    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:31:34.419452 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:34.419401    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"]
Oct 31 00:31:34.420071 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:34.419672    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy" containerID="cri-o://a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997" gracePeriod=30
Oct 31 00:31:39.712489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.712459    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:31:39.780177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780134    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780179    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780209    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780249    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780275    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780328    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780366    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780429    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780469    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket\") pod \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\" (UID: \"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b\") "
Oct 31 00:31:39.780709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780574    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:31:39.780709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780590    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:31:39.780992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780754    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:31:39.780992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.780869    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:31:39.781106 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.781012    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.781106 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.781035    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.781106 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.781051    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.781106 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.781065    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.781314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.781284    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:31:39.782706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.782675    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:31:39.782706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.782696    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:31:39.782891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.782868    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:31:39.782986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.782969    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht" pod "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" (UID: "2446d6f0-e254-4ac5-85c4-d5b0e4fb851b"). InnerVolumeSpecName "kube-api-access-cd4ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:31:39.882051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.882012    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd4ht\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-kube-api-access-cd4ht\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.882051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.882044    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.882051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.882055    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.882353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.882064    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:39.882353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:39.882073    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:31:40.205884 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.205851    5925 generic.go:356] "Generic (PLEG): container finished" podID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerID="a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997" exitCode=0
Oct 31 00:31:40.206057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.205908    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"
Oct 31 00:31:40.206057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.205937    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" event={"ID":"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b","Type":"ContainerDied","Data":"a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997"}
Oct 31 00:31:40.206057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.205995    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs" event={"ID":"2446d6f0-e254-4ac5-85c4-d5b0e4fb851b","Type":"ContainerDied","Data":"106c543b29af4ca9c5947b1ff9647ed748a0af0ad38fb635d1dcef8286b7f239"}
Oct 31 00:31:40.206057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.206026    5925 scope.go:122] "RemoveContainer" containerID="a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997"
Oct 31 00:31:40.217596 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.217570    5925 scope.go:122] "RemoveContainer" containerID="a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997"
Oct 31 00:31:40.217902 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:31:40.217873    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997\": container with ID starting with a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997 not found: ID does not exist" containerID="a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997"
Oct 31 00:31:40.217965 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.217910    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997"} err="failed to get container status \"a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997\": rpc error: code = NotFound desc = could not find container \"a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997\": container with ID starting with a933d1e07d200311350dc491100946548ed2a1266c060505288a10e5c4136997 not found: ID does not exist"
Oct 31 00:31:40.367148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.367105    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"]
Oct 31 00:31:40.413298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.413264    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qkkjs"]
Oct 31 00:31:40.452459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:31:40.452409    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" path="/var/lib/kubelet/pods/2446d6f0-e254-4ac5-85c4-d5b0e4fb851b/volumes"
Oct 31 00:31:46.551488 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:31:46.551448    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:32:02.397429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.397389    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"]
Oct 31 00:32:02.397954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.397937    5925 cpu_manager.go:414] "containerMap: removing container" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.398000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.397955    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.398000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.397986    5925 cpu_manager.go:414] "containerMap: removing container" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy"
Oct 31 00:32:02.398000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.397993    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy"
Oct 31 00:32:02.398122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.398010    5925 cpu_manager.go:414] "containerMap: removing container" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.398122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.398015    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.398122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.398115    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="2446d6f0-e254-4ac5-85c4-d5b0e4fb851b" containerName="istio-proxy"
Oct 31 00:32:02.398122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.398122    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.398334 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.398132    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.398334 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.398138    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:02.402814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.402793    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.457914 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.457881    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"]
Oct 31 00:32:02.501696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.501664    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-e8ba06\"/\"default-dockercfg-f86h9\""
Oct 31 00:32:02.501862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.501704    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-e8ba06\"/\"openshift-service-ca.crt\""
Oct 31 00:32:02.501862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.501737    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-e8ba06\"/\"distinct-w2-e8ba06-kserve-self-signed-certs\""
Oct 31 00:32:02.501862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.501741    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-e8ba06\"/\"kube-root-ca.crt\""
Oct 31 00:32:02.534658 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.534626    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.534806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.534668    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.534806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.534781    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgmz\" (UniqueName: \"kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.534884 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.534834    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.534918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.534907    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.534967 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.534954    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.635659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.635625    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.635838 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.635795    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.635925 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.635841    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.635925 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.635894    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chgmz\" (UniqueName: \"kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.636037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.635933    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.636037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.635964    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.636146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.636105    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.636289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.636264    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.636289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.636277    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.638053 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.638037    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.638390 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.638373    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.697757 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.697691    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgmz\" (UniqueName: \"kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz\") pod \"distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") " pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:02.715730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:02.715701    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:03.115562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:03.115523    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"]
Oct 31 00:32:03.121647 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:32:03.121616    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09160224_0dc7_45f8_aab6_a9a3778870ee.slice/crio-1c3d94086738085883b089ce9c3d84a4c4588b628b1cbeff46800b075caef239 WatchSource:0}: Error finding container 1c3d94086738085883b089ce9c3d84a4c4588b628b1cbeff46800b075caef239: Status 404 returned error can't find the container with id 1c3d94086738085883b089ce9c3d84a4c4588b628b1cbeff46800b075caef239
Oct 31 00:32:03.368426 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:03.368310    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" event={"ID":"09160224-0dc7-45f8-aab6-a9a3778870ee","Type":"ContainerStarted","Data":"5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680"}
Oct 31 00:32:03.368426 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:03.368361    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" event={"ID":"09160224-0dc7-45f8-aab6-a9a3778870ee","Type":"ContainerStarted","Data":"1c3d94086738085883b089ce9c3d84a4c4588b628b1cbeff46800b075caef239"}
Oct 31 00:32:03.483022 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:03.482966    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" podStartSLOduration=1.482948804 podStartE2EDuration="1.482948804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:32:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:32:03.480486408 +0000 UTC m=+1025.169366355" watchObservedRunningTime="2026-10-31 00:32:03.482948804 +0000 UTC m=+1025.171828749"
Oct 31 00:32:03.716818 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:03.716729    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:12.716838 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:12.716804    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:12.730265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:12.730229    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:13.444901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:13.444868    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:32:16.552030 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:32:16.551984    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:32:40.220763 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.220722    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"]
Oct 31 00:32:40.221508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.221487    5925 cpu_manager.go:414] "containerMap: removing container" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:40.221629 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.221509    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="112ea309-548a-45a4-8f02-a30b8ca3e3c7" containerName="cleanup"
Oct 31 00:32:40.225603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.225580    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.275843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.275820    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-e8ba06-openshift-default-dockercfg-97jbg\""
Oct 31 00:32:40.326082 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.326044    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"]
Oct 31 00:32:40.367065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367024    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367068    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4v9\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367146    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367205    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367240    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367345    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367370    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367393    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.367535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.367522    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468455 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468423    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468461    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468494    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468547    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468616    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468653    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4v9\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468704    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468729    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.468835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468751    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.469049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.468924    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.469308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.469249    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.469308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.469273    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.469459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.469304    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.469459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.469332    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.470847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.470792    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.471115 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.471097    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.527211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.527180    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.527461 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.527440    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4v9\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.539681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.539656    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:40.980330 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.980293    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"]
Oct 31 00:32:40.983758 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:32:40.983730    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd9406f_7698_40e5_88d1_36056858ff5e.slice/crio-2add712c18d0da9a189548dbb77260baefcc068fe93fbfd04d9ccf4c2a880eaa WatchSource:0}: Error finding container 2add712c18d0da9a189548dbb77260baefcc068fe93fbfd04d9ccf4c2a880eaa: Status 404 returned error can't find the container with id 2add712c18d0da9a189548dbb77260baefcc068fe93fbfd04d9ccf4c2a880eaa
Oct 31 00:32:40.986010 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.985979    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:32:40.986113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.986040    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:32:40.986113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:40.986070    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:32:41.680997 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:41.680962    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" event={"ID":"6cd9406f-7698-40e5-88d1-36056858ff5e","Type":"ContainerStarted","Data":"ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857"}
Oct 31 00:32:41.681531 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:41.681056    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" event={"ID":"6cd9406f-7698-40e5-88d1-36056858ff5e","Type":"ContainerStarted","Data":"2add712c18d0da9a189548dbb77260baefcc068fe93fbfd04d9ccf4c2a880eaa"}
Oct 31 00:32:41.800133 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:41.800071    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podStartSLOduration=1.800051956 podStartE2EDuration="1.800051956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:32:41.799906669 +0000 UTC m=+1063.488786616" watchObservedRunningTime="2026-10-31 00:32:41.800051956 +0000 UTC m=+1063.488931903"
Oct 31 00:32:42.552456 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:42.552401    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:42.575514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:42.556316    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:32:42.575761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:42.575733    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 00:32:43.541854 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:43.541806    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:32:43.542559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:43.542525    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 00:32:44.541751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:44.541712    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:32:44.542149 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:44.542121    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 00:32:45.557444 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:45.552734    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:32:45.568246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:45.557996    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 00:32:46.563483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:46.544768    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:32:46.563483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:46.544830    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 00:32:46.573253 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:32:46.573214    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:32:47.540281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:47.540236    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:32:47.540509 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:47.540294    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 31 00:32:48.544990 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:48.544959    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:48.545507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:48.545457    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:48.546220 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:48.546199    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:32:56.013559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.013525    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"]
Oct 31 00:32:56.017771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.017751    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.068154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.068119    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-1e5e75-openshift-default-dockercfg-gw4mk\""
Oct 31 00:32:56.127503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.127462    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"]
Oct 31 00:32:56.178083 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178046    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178083 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178088    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178111    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178185    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178229    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178257    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178289    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178472    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lwq4\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.178602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.178534    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280195    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280234    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280256    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280278    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280305    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280343    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280494    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280568    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lwq4\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280627    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.280928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.280744    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.281062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.281038    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.281167 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.281146    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.281299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.281278    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.281367 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.281309    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.283002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.282978    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.283104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.282980    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.341365 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.341335    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.341672 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.341653    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lwq4\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:56.632953 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:56.632925    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:57.064752 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.064665    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"]
Oct 31 00:32:57.070289 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:32:57.070262    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f279b8_7f43_42cc_81fb_ed4dad1e5428.slice/crio-1facfaad27d7b74babafcd73db243f43c42736dddfcfd751a459c06f1b2669bc WatchSource:0}: Error finding container 1facfaad27d7b74babafcd73db243f43c42736dddfcfd751a459c06f1b2669bc: Status 404 returned error can't find the container with id 1facfaad27d7b74babafcd73db243f43c42736dddfcfd751a459c06f1b2669bc
Oct 31 00:32:57.072777 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.072745    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:32:57.072858 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.072812    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:32:57.072858 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.072838    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:32:57.789485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.789446    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" event={"ID":"f7f279b8-7f43-42cc-81fb-ed4dad1e5428","Type":"ContainerStarted","Data":"d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8"}
Oct 31 00:32:57.789695 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.789512    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" event={"ID":"f7f279b8-7f43-42cc-81fb-ed4dad1e5428","Type":"ContainerStarted","Data":"1facfaad27d7b74babafcd73db243f43c42736dddfcfd751a459c06f1b2669bc"}
Oct 31 00:32:57.926493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:57.926404    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podStartSLOduration=2.926386754 podStartE2EDuration="2.926386754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:32:57.924958553 +0000 UTC m=+1079.613838500" watchObservedRunningTime="2026-10-31 00:32:57.926386754 +0000 UTC m=+1079.615266702"
Oct 31 00:32:58.633787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:58.633754    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:32:58.635572 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:58.635538    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:32:58.635713 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:58.635599    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 00:32:59.634139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:59.634106    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:32:59.634573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:32:59.634157    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 00:33:00.633282 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:00.633248    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:33:00.633583 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:00.633308    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 00:33:01.634175 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:01.634139    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:33:01.634601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:01.634191    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 00:33:02.633462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:02.633393    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:33:02.633650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:02.633483    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 00:33:03.832469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:03.832403    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:33:03.833134 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:03.833020    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:33:03.834398 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:03.834369    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:33:16.542454 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:33:16.542388    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:33:34.890894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.890847    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"]
Oct 31 00:33:34.895749 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.895721    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:34.965235 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.965203    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a6f4a5\"/\"default-dockercfg-n9zmp\""
Oct 31 00:33:34.993388 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.993358    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a6f4a5\"/\"distinct-w6-a6f4a5-kserve-self-signed-certs\""
Oct 31 00:33:34.993594 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.993452    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-a6f4a5\"/\"openshift-service-ca.crt\""
Oct 31 00:33:34.993594 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.993472    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-a6f4a5\"/\"kube-root-ca.crt\""
Oct 31 00:33:34.996225 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:34.996198    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"]
Oct 31 00:33:35.029203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.029162    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhz7\" (UniqueName: \"kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.029451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.029230    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.029451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.029265    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.029451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.029301    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.029720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.029456    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.029720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.029498    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.130713 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.130685    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.130889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.130721    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.130889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.130777    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhz7\" (UniqueName: \"kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.130889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.130804    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.130889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.130823    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.131043 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.130973    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.131252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.131231    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.131347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.131257    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.131347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.131277    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.133062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.133039    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.133297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.133281    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.189244 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.189174    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhz7\" (UniqueName: \"kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7\") pod \"distinct-w6-a6f4a5-kserve-c774769d4-5p9hq\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.210796 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.210773    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:35.622991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:35.622960    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"]
Oct 31 00:33:35.629580 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:33:35.629555    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod125105e1_e44b_49f1_81df_b6bfa16d1602.slice/crio-8e4f6b3c096d77176354c1dfa23bfa0d7d83891bc9dfd0131da03463fe48a1c0 WatchSource:0}: Error finding container 8e4f6b3c096d77176354c1dfa23bfa0d7d83891bc9dfd0131da03463fe48a1c0: Status 404 returned error can't find the container with id 8e4f6b3c096d77176354c1dfa23bfa0d7d83891bc9dfd0131da03463fe48a1c0
Oct 31 00:33:36.065258 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:36.065157    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" event={"ID":"125105e1-e44b-49f1-81df-b6bfa16d1602","Type":"ContainerStarted","Data":"e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e"}
Oct 31 00:33:36.065258 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:36.065212    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" event={"ID":"125105e1-e44b-49f1-81df-b6bfa16d1602","Type":"ContainerStarted","Data":"8e4f6b3c096d77176354c1dfa23bfa0d7d83891bc9dfd0131da03463fe48a1c0"}
Oct 31 00:33:36.191374 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:36.191320    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" podStartSLOduration=2.191304337 podStartE2EDuration="2.191304337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:36.176907789 +0000 UTC m=+1117.865787735" watchObservedRunningTime="2026-10-31 00:33:36.191304337 +0000 UTC m=+1117.880184282"
Oct 31 00:33:36.211575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:36.211519    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:42.571213 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.571171    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"]
Oct 31 00:33:42.575194 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.575170    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.617860 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.617829    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.617991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.617867    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.617991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.617903    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwdm4\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.618069 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.618011    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.618069 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.618055    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.618131 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.618085    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.618163 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.618137    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.618244 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.618227    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.618278 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.618254    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.625113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.625095    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-101b9e-openshift-default-dockercfg-8l66m\""
Oct 31 00:33:42.675914 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.675886    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"]
Oct 31 00:33:42.719489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719458    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719513    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719554    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719606    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719632    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719724    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719762    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719806    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwdm4\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.719880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719858    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.720068 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.719906    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.720224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.720202    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.720358 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.720339    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.720489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.720469    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.720568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.720556    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.722335 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.722311    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.722577 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.722556    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.779161 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.779138    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.779297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.779218    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwdm4\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:42.893498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:42.893461    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:43.330076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:43.329995    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"]
Oct 31 00:33:43.335366 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:33:43.335332    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9385b50e_5ba5_454e_bf08_9c77ae52d75f.slice/crio-3895235b9c7ba991942b1a47d70e38081cb465c9fb09f44c836e65b7d200aab8 WatchSource:0}: Error finding container 3895235b9c7ba991942b1a47d70e38081cb465c9fb09f44c836e65b7d200aab8: Status 404 returned error can't find the container with id 3895235b9c7ba991942b1a47d70e38081cb465c9fb09f44c836e65b7d200aab8
Oct 31 00:33:43.337576 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:43.337547    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:33:43.337646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:43.337612    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:33:43.337646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:43.337640    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:33:44.126052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:44.126013    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" event={"ID":"9385b50e-5ba5-454e-bf08-9c77ae52d75f","Type":"ContainerStarted","Data":"16cb4754573ad3f53f611a8421fd12c167b2f5b10ae2acb86850243c786d1ad0"}
Oct 31 00:33:44.126467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:44.126076    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" event={"ID":"9385b50e-5ba5-454e-bf08-9c77ae52d75f","Type":"ContainerStarted","Data":"3895235b9c7ba991942b1a47d70e38081cb465c9fb09f44c836e65b7d200aab8"}
Oct 31 00:33:44.290623 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:44.290569    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podStartSLOduration=2.2905554759999998 podStartE2EDuration="2.290555476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:44.288829478 +0000 UTC m=+1125.977709424" watchObservedRunningTime="2026-10-31 00:33:44.290555476 +0000 UTC m=+1125.979435420"
Oct 31 00:33:44.894349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:44.894309    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:44.895961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:44.895940    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 00:33:44.896019 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:44.895989    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 00:33:45.211880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:45.211793    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:45.224275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:45.224243    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:45.894378 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:45.894338    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 00:33:45.894577 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:45.894404    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 00:33:46.179802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:46.179710    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:33:46.563140 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:33:46.562826    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:33:46.894076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:46.894032    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 00:33:46.894282 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:46.894094    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 00:33:47.894250 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:47.894210    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 00:33:47.894690 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:47.894278    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 00:33:48.893934 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:48.893888    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 00:33:48.894124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:48.893953    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 00:33:50.094733 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:50.094694    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:50.095217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:50.095172    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:33:50.096213 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:33:50.096186    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:34:16.550092 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:34:16.550052    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:34:21.443952 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.443920    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-qsnc8-f728q"]
Oct 31 00:34:21.448297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.448272    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.488695 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.488661    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.488856 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.488733    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwrg6\" (UniqueName: \"kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.488856 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.488820    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.488946 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.488854    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.500454 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.500407    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-qsnc8-f728q"]
Oct 31 00:34:21.590490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.590456    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.590654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.590549    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwrg6\" (UniqueName: \"kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.590654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.590603    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.590654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.590633    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.590898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.590879    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.591243 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.591217    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.591445 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.591395    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.649191 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.649152    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwrg6\" (UniqueName: \"kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6\") pod \"periodic-gathering-qsnc8-f728q\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") " pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:21.761340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:21.761263    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:34:22.139656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:22.139623    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-qsnc8-f728q"]
Oct 31 00:34:22.145826 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:34:22.145790    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915a3055_f684_473d_8b70_34935c67ba2d.slice/crio-52f41ce3cedd35f34074059f9b42fe74b5b0f2766a6e9d6bdb257a900bea78d5 WatchSource:0}: Error finding container 52f41ce3cedd35f34074059f9b42fe74b5b0f2766a6e9d6bdb257a900bea78d5: Status 404 returned error can't find the container with id 52f41ce3cedd35f34074059f9b42fe74b5b0f2766a6e9d6bdb257a900bea78d5
Oct 31 00:34:22.418752 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:22.418648    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qsnc8-f728q" event={"ID":"915a3055-f684-473d-8b70-34935c67ba2d","Type":"ContainerStarted","Data":"eb2e65a3d41e6e6c2130c579fb4605870512759dd5dd9e66406f1b6c6a82f965"}
Oct 31 00:34:22.418752 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:22.418712    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qsnc8-f728q" event={"ID":"915a3055-f684-473d-8b70-34935c67ba2d","Type":"ContainerStarted","Data":"52f41ce3cedd35f34074059f9b42fe74b5b0f2766a6e9d6bdb257a900bea78d5"}
Oct 31 00:34:22.531765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:22.531709    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-qsnc8-f728q" podStartSLOduration=1.53169591 podStartE2EDuration="1.53169591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:22.530531325 +0000 UTC m=+1164.219411271" watchObservedRunningTime="2026-10-31 00:34:22.53169591 +0000 UTC m=+1164.220575858"
Oct 31 00:34:26.426641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.426601    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"]
Oct 31 00:34:26.430739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.430716    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.533492 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.533454    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"]
Oct 31 00:34:26.551453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551393    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551452    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551490    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551595    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551817    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551885 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551855    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551930 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551882    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.551930 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551908    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g8sd\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.552026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.551940    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.652857 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.652820    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.652987    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653036 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653017    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653042    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653079    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8sd\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653126    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653157    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653185    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653189    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653229    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653526    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653677    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653841 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653718    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.653945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.653926    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.656106 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.656079    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.656224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.656207    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.712072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.711998    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8sd\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.712072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.712011    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token\") pod \"e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") " pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:26.744748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:26.744717    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:27.182852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.182817    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"]
Oct 31 00:34:27.188635 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:34:27.188593    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0716c17a_decd_45d1_9208_724f02257880.slice/crio-b023b53549756b3758be5a9e67da531c04a58fbf45a83ddb3d44aa018c6b016c WatchSource:0}: Error finding container b023b53549756b3758be5a9e67da531c04a58fbf45a83ddb3d44aa018c6b016c: Status 404 returned error can't find the container with id b023b53549756b3758be5a9e67da531c04a58fbf45a83ddb3d44aa018c6b016c
Oct 31 00:34:27.191247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.191216    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:34:27.191324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.191288    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:34:27.191324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.191318    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:34:27.455178 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.455091    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" event={"ID":"0716c17a-decd-45d1-9208-724f02257880","Type":"ContainerStarted","Data":"b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d"}
Oct 31 00:34:27.455563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.455183    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" event={"ID":"0716c17a-decd-45d1-9208-724f02257880","Type":"ContainerStarted","Data":"b023b53549756b3758be5a9e67da531c04a58fbf45a83ddb3d44aa018c6b016c"}
Oct 31 00:34:27.573051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.572996    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podStartSLOduration=1.572981882 podStartE2EDuration="1.572981882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:27.570405857 +0000 UTC m=+1169.259285794" watchObservedRunningTime="2026-10-31 00:34:27.572981882 +0000 UTC m=+1169.261861828"
Oct 31 00:34:27.750982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:27.750885    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:28.762439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:28.756786    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:34:28.762439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:28.756871    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:34:29.748446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:29.747798    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:34:29.748446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:29.747861    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:34:30.761439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:30.747804    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:34:30.761439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:30.747879    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:34:31.754440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:31.753811    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:34:31.754440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:31.753878    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:34:32.755438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:32.750818    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:34:32.755438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:32.750880    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:34:33.745912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:33.745873    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:34:33.746094 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:33.745928    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:34:34.750214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:34.750179    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:34.750732 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:34.750596    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:34.751451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:34.751399    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:34:46.543947 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:34:46.543899    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:34:58.647466 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:58.647438    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:34:58.650903 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:34:58.650876    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:35:16.544356 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:35:16.544315    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:35:33.427850 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.427813    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"]
Oct 31 00:35:33.431889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.431869    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.530257 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.530225    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-a6f4a5\"/\"distinct-2-w6-a6f4a5-kserve-self-signed-certs\""
Oct 31 00:35:33.535215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.535192    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"]
Oct 31 00:35:33.593231 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.593191    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.593553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.593525    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.593723 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.593563    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.593723 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.593661    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.593883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.593747    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4sl7\" (UniqueName: \"kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.593883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.593816    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.694956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.694879    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.694956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.694950    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695135 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.694977    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695135 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.695049    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.695133    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4sl7\" (UniqueName: \"kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.695194    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695339 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.695312    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695542 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.695516    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.695632 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.695527    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.697262 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.697239    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.697606 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.697589    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:33.754002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:33.753980    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4sl7\" (UniqueName: \"kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7\") pod \"distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") " pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:34.047032 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:34.046954    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:34.432396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:34.432360    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"]
Oct 31 00:35:34.438879 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:35:34.438850    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13f5d606_d28a_41e7_88ea_28d00d92f286.slice/crio-2fc300052b08d54b35c62dccb4468b3858c7808a7160816990b97af88f309346 WatchSource:0}: Error finding container 2fc300052b08d54b35c62dccb4468b3858c7808a7160816990b97af88f309346: Status 404 returned error can't find the container with id 2fc300052b08d54b35c62dccb4468b3858c7808a7160816990b97af88f309346
Oct 31 00:35:35.009563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:35.009530    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" event={"ID":"13f5d606-d28a-41e7-88ea-28d00d92f286","Type":"ContainerStarted","Data":"1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7"}
Oct 31 00:35:35.009739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:35.009571    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" event={"ID":"13f5d606-d28a-41e7-88ea-28d00d92f286","Type":"ContainerStarted","Data":"2fc300052b08d54b35c62dccb4468b3858c7808a7160816990b97af88f309346"}
Oct 31 00:35:35.047170 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:35.047141    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:35.123872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:35.123822    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podStartSLOduration=2.123806751 podStartE2EDuration="2.123806751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:35:35.121102493 +0000 UTC m=+1236.809982439" watchObservedRunningTime="2026-10-31 00:35:35.123806751 +0000 UTC m=+1236.812686734"
Oct 31 00:35:44.047962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:44.047921    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:44.066253 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:44.066224    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:44.100227 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:44.100203    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:35:46.546745 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:35:46.546700    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:35:49.587533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:49.587495    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:35:49.588257 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:49.588220    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:35:58.294965 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:58.294933    5925 generic.go:356] "Generic (PLEG): container finished" podID="915a3055-f684-473d-8b70-34935c67ba2d" containerID="eb2e65a3d41e6e6c2130c579fb4605870512759dd5dd9e66406f1b6c6a82f965" exitCode=0
Oct 31 00:35:58.295488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:58.295012    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qsnc8-f728q" event={"ID":"915a3055-f684-473d-8b70-34935c67ba2d","Type":"ContainerDied","Data":"eb2e65a3d41e6e6c2130c579fb4605870512759dd5dd9e66406f1b6c6a82f965"}
Oct 31 00:35:59.448302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.448277    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:35:59.535700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.535673    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path\") pod \"915a3055-f684-473d-8b70-34935c67ba2d\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") "
Oct 31 00:35:59.535870 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.535806    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6\" (UniqueName: \"kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6\") pod \"915a3055-f684-473d-8b70-34935c67ba2d\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") "
Oct 31 00:35:59.535936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.535914    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle\") pod \"915a3055-f684-473d-8b70-34935c67ba2d\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") "
Oct 31 00:35:59.535996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.535957    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle\") pod \"915a3055-f684-473d-8b70-34935c67ba2d\" (UID: \"915a3055-f684-473d-8b70-34935c67ba2d\") "
Oct 31 00:35:59.536058 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.536005    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path" pod "915a3055-f684-473d-8b70-34935c67ba2d" (UID: "915a3055-f684-473d-8b70-34935c67ba2d"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:35:59.536403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.536374    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle" pod "915a3055-f684-473d-8b70-34935c67ba2d" (UID: "915a3055-f684-473d-8b70-34935c67ba2d"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:35:59.536533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.536500    5925 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/915a3055-f684-473d-8b70-34935c67ba2d-archives-path\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:35:59.536533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.536524    5925 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-service-ca-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:35:59.536856 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.536834    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle" pod "915a3055-f684-473d-8b70-34935c67ba2d" (UID: "915a3055-f684-473d-8b70-34935c67ba2d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:35:59.538503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.538472    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6" pod "915a3055-f684-473d-8b70-34935c67ba2d" (UID: "915a3055-f684-473d-8b70-34935c67ba2d"). InnerVolumeSpecName "kube-api-access-lwrg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:35:59.637727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.637694    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwrg6\" (UniqueName: \"kubernetes.io/projected/915a3055-f684-473d-8b70-34935c67ba2d-kube-api-access-lwrg6\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:35:59.637727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:35:59.637724    5925 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/915a3055-f684-473d-8b70-34935c67ba2d-trusted-ca-bundle\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:36:00.309238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:00.309199    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qsnc8-f728q" event={"ID":"915a3055-f684-473d-8b70-34935c67ba2d","Type":"ContainerDied","Data":"52f41ce3cedd35f34074059f9b42fe74b5b0f2766a6e9d6bdb257a900bea78d5"}
Oct 31 00:36:00.309431 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:00.309253    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qsnc8-f728q"
Oct 31 00:36:00.309431 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:00.309256    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52f41ce3cedd35f34074059f9b42fe74b5b0f2766a6e9d6bdb257a900bea78d5"
Oct 31 00:36:16.542685 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:36:16.542604    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:36:27.031982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.031946    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"]
Oct 31 00:36:27.032573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.032557    5925 cpu_manager.go:414] "containerMap: removing container" podUID="915a3055-f684-473d-8b70-34935c67ba2d" containerName="insights-gathering"
Oct 31 00:36:27.032633 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.032574    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="915a3055-f684-473d-8b70-34935c67ba2d" containerName="insights-gathering"
Oct 31 00:36:27.032677 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.032666    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="915a3055-f684-473d-8b70-34935c67ba2d" containerName="insights-gathering"
Oct 31 00:36:27.036264 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.036247    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.074551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.074514    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.074779 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.074759    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srpts\" (UniqueName: \"kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.074976 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.074961    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.078400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.078371    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.078605 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.078577    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.078770 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.078681    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.135968 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.135923    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-982ae3\"/\"default-dockercfg-jh7nw\""
Oct 31 00:36:27.136153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.136101    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-982ae3\"/\"distinct-2-w1-982ae3-kserve-self-signed-certs\""
Oct 31 00:36:27.136153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.136113    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-982ae3\"/\"openshift-service-ca.crt\""
Oct 31 00:36:27.136286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.136157    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-982ae3\"/\"kube-root-ca.crt\""
Oct 31 00:36:27.139633 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.139607    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"]
Oct 31 00:36:27.180152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180108    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180161    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srpts\" (UniqueName: \"kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180267    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180293    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180319    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180603    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180624    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180654    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.180889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.180851    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.182835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.182817    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.183079 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.183058    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.280284 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.280246    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srpts\" (UniqueName: \"kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts\") pod \"distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") " pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.350793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.350753    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:27.648033 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.647961    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"]
Oct 31 00:36:27.653212 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.653181    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.686993    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687041    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687156    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687183    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687252    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687428 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687364    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2rmw\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687425    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687543 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687496    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.687598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.687550    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.709977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.709945    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"]
Oct 31 00:36:27.768168 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.768124    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"]
Oct 31 00:36:27.774867 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:36:27.774835    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27401dfd_ad05_4055_8e63_6445894bc55b.slice/crio-5d55a039846e75e5d79088d07ccab4f32e6204828777f9e4408306f48ef1092d WatchSource:0}: Error finding container 5d55a039846e75e5d79088d07ccab4f32e6204828777f9e4408306f48ef1092d: Status 404 returned error can't find the container with id 5d55a039846e75e5d79088d07ccab4f32e6204828777f9e4408306f48ef1092d
Oct 31 00:36:27.788400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788369    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788516 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788447    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788516 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788492    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788560    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788591    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788649    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788675    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788738    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788819    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2rmw\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.788913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.788899    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.789359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.789109    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.789359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.789173    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.789539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.789444    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.789539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.789483    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.791610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.791586    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.791760 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.791743    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.848099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.848070    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2rmw\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.848859 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.848817    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token\") pod \"e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") " pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:27.971537 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:27.971201    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:28.403708 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.403666    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"]
Oct 31 00:36:28.413785 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.413747    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:28.413970 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.413949    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:28.414149 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.414130    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:28.507769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.507740    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" event={"ID":"27401dfd-ad05-4055-8e63-6445894bc55b","Type":"ContainerStarted","Data":"bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b"}
Oct 31 00:36:28.507894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.507783    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" event={"ID":"27401dfd-ad05-4055-8e63-6445894bc55b","Type":"ContainerStarted","Data":"5d55a039846e75e5d79088d07ccab4f32e6204828777f9e4408306f48ef1092d"}
Oct 31 00:36:28.509622 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.509598    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" event={"ID":"d945f2ec-44ad-4b24-b81a-89fa845c71f6","Type":"ContainerStarted","Data":"ee72a274fb4cd6b4cf186c992e11ff59fbd2f5f261d8a249e4b583f6823d7c35"}
Oct 31 00:36:28.630296 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:28.630243    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podStartSLOduration=2.630229854 podStartE2EDuration="2.630229854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:28.628055876 +0000 UTC m=+1290.316935823" watchObservedRunningTime="2026-10-31 00:36:28.630229854 +0000 UTC m=+1290.319109834"
Oct 31 00:36:29.358439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:29.357521    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:29.518244 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:29.518203    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" event={"ID":"d945f2ec-44ad-4b24-b81a-89fa845c71f6","Type":"ContainerStarted","Data":"17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289"}
Oct 31 00:36:29.729464 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:29.729343    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podStartSLOduration=2.729328619 podStartE2EDuration="2.729328619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:29.681942468 +0000 UTC m=+1291.370822451" watchObservedRunningTime="2026-10-31 00:36:29.729328619 +0000 UTC m=+1291.418208561"
Oct 31 00:36:29.972145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:29.972103    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:29.973522 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:29.973496    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 31 00:36:29.973659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:29.973542    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 31 00:36:30.972427 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:30.972379    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 31 00:36:30.972842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:30.972454    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 31 00:36:31.972499 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:31.972463    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 31 00:36:31.972923 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:31.972518    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 31 00:36:32.972227 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:32.972193    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 31 00:36:32.972607 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:32.972258    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 31 00:36:33.972600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:33.972551    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 31 00:36:33.973164 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:33.972616    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 31 00:36:34.971950 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:34.971903    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 31 00:36:34.972149 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:34.971973    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 31 00:36:35.976469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:35.976437    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:35.976863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:35.976741    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:35.977371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:35.977352    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:36:37.351795 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:37.351758    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:37.364921 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:37.364895    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:37.605748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:37.605666    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:36:44.341496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.341456    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"]
Oct 31 00:36:44.346888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.346862    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.403570 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.403535    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"]
Oct 31 00:36:44.407866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.407837    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.407905    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408018    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408060    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408189    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408284 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408229    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408339    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408395 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408383    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjm6\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.408518 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.408468    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.509653 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509613    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.509863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509674    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.509863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509698    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.509863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509772    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.509863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509795    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510093 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509883    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510093 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509940    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjm6\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510093 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.509976    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.510123    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510534 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.510499    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510745 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.510672    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.510777    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.510936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.510907    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.511039 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.511018    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.512933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.512904    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.513021 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.512974    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.569689 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.569644    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.569872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.569764    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjm6\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6\") pod \"e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") " pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:44.662680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:44.662591    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:45.180317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.180268    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"]
Oct 31 00:36:45.193173 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:36:45.193139    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef63974a_5d38_41cb_ab97_18acbbdb8a1a.slice/crio-270d9c2a09a299402e99f622c998c8cd2f8efa3018b7b3e0e42934f19543d704 WatchSource:0}: Error finding container 270d9c2a09a299402e99f622c998c8cd2f8efa3018b7b3e0e42934f19543d704: Status 404 returned error can't find the container with id 270d9c2a09a299402e99f622c998c8cd2f8efa3018b7b3e0e42934f19543d704
Oct 31 00:36:45.201237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.201191    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:45.201340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.201287    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:45.201340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.201328    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:45.648100 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.648065    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" event={"ID":"ef63974a-5d38-41cb-ab97-18acbbdb8a1a","Type":"ContainerStarted","Data":"49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64"}
Oct 31 00:36:45.648638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.648131    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" event={"ID":"ef63974a-5d38-41cb-ab97-18acbbdb8a1a","Type":"ContainerStarted","Data":"270d9c2a09a299402e99f622c998c8cd2f8efa3018b7b3e0e42934f19543d704"}
Oct 31 00:36:45.663575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.663539    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:45.874748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:45.874673    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podStartSLOduration=1.874653793 podStartE2EDuration="1.874653793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:45.813141261 +0000 UTC m=+1307.502021209" watchObservedRunningTime="2026-10-31 00:36:45.874653793 +0000 UTC m=+1307.563533739"
Oct 31 00:36:46.582158 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:36:46.582117    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:36:46.670732 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:46.670692    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 00:36:46.671401 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:46.671366    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 00:36:47.668439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:47.667691    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 00:36:47.668439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:47.667755    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 00:36:48.667321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:48.666870    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 00:36:48.667321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:48.666934    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 00:36:49.666868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:49.666825    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 00:36:49.667163 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:49.667130    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 00:36:50.663335 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:50.663297    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 00:36:50.663969 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:50.663935    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 00:36:51.663283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:51.663241    5925 patch_prober.go:29] interesting pod/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 00:36:51.663502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:51.663326    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 00:36:52.845267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:52.845237    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:52.845771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:52.845751    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:52.846632 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:52.846611    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:36:57.246426 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.246387    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"]
Oct 31 00:36:57.250849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.250824    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.309382 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.309340    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"]
Oct 31 00:36:57.411422 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411386    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411608 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411470    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411608 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411493    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411633    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411670    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hmc\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411763 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411743    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411840 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411819    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411866    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.411916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.411889    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513236    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513280    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513306    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513356    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513386    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22hmc\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513449    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513494    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513539    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513568    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513765    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513998 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513940    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.513998 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.513965    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.514127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.514101    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.514552 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.514530    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.516057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.516025    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.516171 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.516154    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.574818 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.574775    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hmc\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.576469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.576164    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:57.868074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:57.868029    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:58.321157 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.321048    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"]
Oct 31 00:36:58.328882 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:36:58.328848    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52deace2_9bc5_489f_86bb_063c9dfc8408.slice/crio-fcbf6ac354f2af7ee5d5e4cac91bccdd34a02f1116657d01730070e0272864ef WatchSource:0}: Error finding container fcbf6ac354f2af7ee5d5e4cac91bccdd34a02f1116657d01730070e0272864ef: Status 404 returned error can't find the container with id fcbf6ac354f2af7ee5d5e4cac91bccdd34a02f1116657d01730070e0272864ef
Oct 31 00:36:58.331271 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.331235    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:58.331357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.331305    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:58.331357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.331344    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:36:58.776205 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.776169    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" event={"ID":"52deace2-9bc5-489f-86bb-063c9dfc8408","Type":"ContainerStarted","Data":"83bacd84d3dd0620c7615c787e910309712a51a297e3bc577c610951755bd590"}
Oct 31 00:36:58.776446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.776221    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" event={"ID":"52deace2-9bc5-489f-86bb-063c9dfc8408","Type":"ContainerStarted","Data":"fcbf6ac354f2af7ee5d5e4cac91bccdd34a02f1116657d01730070e0272864ef"}
Oct 31 00:36:58.869483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.869446    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:36:58.988703 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:58.988640    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podStartSLOduration=1.988624378 podStartE2EDuration="1.988624378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:36:58.93921979 +0000 UTC m=+1320.628099737" watchObservedRunningTime="2026-10-31 00:36:58.988624378 +0000 UTC m=+1320.677504393"
Oct 31 00:36:59.873745 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:59.873540    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 00:36:59.873745 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:36:59.873618    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 00:37:00.868885 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:00.868845    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 00:37:00.869190 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:00.869158    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 00:37:01.869873 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:01.869833    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 00:37:01.870352 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:01.869913    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 00:37:02.869188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:02.869072    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 00:37:02.869188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:02.869140    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 00:37:03.869346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:03.869310    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 00:37:03.869800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:03.869370    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 00:37:04.869217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:04.869176    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 31 00:37:04.869405 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:04.869247    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 31 00:37:05.873147 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:05.873119    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:37:05.873620 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:05.873603    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:37:05.874281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:05.874264    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:37:13.599277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.599240    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"]
Oct 31 00:37:13.604086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.604059    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.646638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.646604    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.646802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.646646    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.646802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.646737    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.646899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.646804    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.646899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.646826    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.647000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.646979    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.647042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.647017    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.647042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.647036    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd5d8\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.647123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.647099    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.704453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.704389    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-982ae3-openshift-default-dockercfg-cwtrb\""
Oct 31 00:37:13.707771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.707745    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"]
Oct 31 00:37:13.748306 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748267    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748306 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748308    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748366    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748387    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748402    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd5d8\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748466    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748542    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748848 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748574    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.748848 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.748630    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.749030 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.749006    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.749096 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.749047    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.749161 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.749090    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.749217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.749156    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.749354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.749325    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.750741 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.750720    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.750997 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.750977    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.809399 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.809361    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.809399 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.809361    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd5d8\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:13.918362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:13.918278    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:14.353381 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.353349    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"]
Oct 31 00:37:14.359137 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:14.359108    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388f81f5_ea9c_467d_bf55_354776c49a1c.slice/crio-c40217ee37184b79781cc1fd47467003a051521c7fa464fba575b2eb8839cb3c WatchSource:0}: Error finding container c40217ee37184b79781cc1fd47467003a051521c7fa464fba575b2eb8839cb3c: Status 404 returned error can't find the container with id c40217ee37184b79781cc1fd47467003a051521c7fa464fba575b2eb8839cb3c
Oct 31 00:37:14.361762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.361722    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:14.361873 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.361813    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:14.361873 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.361848    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:14.907468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.907407    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" event={"ID":"388f81f5-ea9c-467d-bf55-354776c49a1c","Type":"ContainerStarted","Data":"d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca"}
Oct 31 00:37:14.907895 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.907542    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" event={"ID":"388f81f5-ea9c-467d-bf55-354776c49a1c","Type":"ContainerStarted","Data":"c40217ee37184b79781cc1fd47467003a051521c7fa464fba575b2eb8839cb3c"}
Oct 31 00:37:14.918385 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:14.918360    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:15.028912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:15.028855    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podStartSLOduration=2.028840418 podStartE2EDuration="2.028840418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:15.026482887 +0000 UTC m=+1336.715362852" watchObservedRunningTime="2026-10-31 00:37:15.028840418 +0000 UTC m=+1336.717720458"
Oct 31 00:37:15.920289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:15.920254    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 00:37:15.920786 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:15.920305    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 00:37:16.571651 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:16.571609    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:37:16.918630 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:16.918600    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 00:37:16.918871 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:16.918651    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 00:37:17.918830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:17.918798    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 00:37:17.919253 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:17.918851    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 00:37:18.919402 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:18.919359    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 00:37:18.919932 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:18.919446    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 00:37:19.918924 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:19.918886    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 00:37:19.919105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:19.918943    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 00:37:20.919646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:20.919609    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 00:37:20.920034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:20.919662    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 00:37:21.924117 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:21.924087    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:21.924579 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:21.924391    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:21.925049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:21.925033    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:37:28.198437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:28.197564    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:37:28.249439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:28.115265    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:37:28.357438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:28.356485    5925 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": context deadline exceeded"
Oct 31 00:37:28.470497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:28.470259    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:37:28.600438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:28.597383    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": context deadline exceeded"
Oct 31 00:37:30.121058 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.121026    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7357-a5a9d6"]
Oct 31 00:37:30.126529 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.126509    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:30.177217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.177186    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7357-a5a9d6"]
Oct 31 00:37:30.199918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.199843    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrpqv\" (UniqueName: \"kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv\") pod \"test-curl-7357-a5a9d6\" (UID: \"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242\") " pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:30.220686 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.220656    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pdlhw\""
Oct 31 00:37:30.301019 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.300992    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrpqv\" (UniqueName: \"kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv\") pod \"test-curl-7357-a5a9d6\" (UID: \"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242\") " pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:30.359774 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.359746    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrpqv\" (UniqueName: \"kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv\") pod \"test-curl-7357-a5a9d6\" (UID: \"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242\") " pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:30.439618 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.439542    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:30.824445 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.824337    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7357-a5a9d6"]
Oct 31 00:37:30.829860 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:30.829829    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf188ec53_50ff_4e3b_8a0f_5d9ca21dd242.slice/crio-f316ca38dcfd7c0c234d857c6400f9d8de4455a999f818f78ce83fdf3fda73f1 WatchSource:0}: Error finding container f316ca38dcfd7c0c234d857c6400f9d8de4455a999f818f78ce83fdf3fda73f1: Status 404 returned error can't find the container with id f316ca38dcfd7c0c234d857c6400f9d8de4455a999f818f78ce83fdf3fda73f1
Oct 31 00:37:30.831764 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:30.831746    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:37:31.290251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:31.290212    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7357-a5a9d6" event={"ID":"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242","Type":"ContainerStarted","Data":"f316ca38dcfd7c0c234d857c6400f9d8de4455a999f818f78ce83fdf3fda73f1"}
Oct 31 00:37:34.312616 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:34.312527    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7357-a5a9d6" event={"ID":"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242","Type":"ContainerStarted","Data":"9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569"}
Oct 31 00:37:34.423857 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:34.423798    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7357-a5a9d6" podStartSLOduration=1.270075522 podStartE2EDuration="4.423784633s" totalImagesPullingTime="3.153709111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:34.421851928 +0000 UTC m=+1356.110731874" watchObservedRunningTime="2026-10-31 00:37:34.423784633 +0000 UTC m=+1356.112664579"
Oct 31 00:37:35.901935 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:35.901834    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7357-a5a9d6"]
Oct 31 00:37:35.908338 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:35.908307    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7357-a5a9d6"]
Oct 31 00:37:36.067667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.067628    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7357-5838f5"]
Oct 31 00:37:36.068722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.068696    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" containerName="test-curl-7357-a5a9d6"
Oct 31 00:37:36.068722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.068722    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" containerName="test-curl-7357-a5a9d6"
Oct 31 00:37:36.068914 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.068898    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" containerName="test-curl-7357-a5a9d6"
Oct 31 00:37:36.073514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.073489    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:36.111809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.111783    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwzrc\" (UniqueName: \"kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc\") pod \"test-curl-7357-5838f5\" (UID: \"14eca155-7c0d-4992-b227-dcbca885e728\") " pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:36.121029 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.120999    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7357-5838f5"]
Oct 31 00:37:36.213556 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.213467    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwzrc\" (UniqueName: \"kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc\") pod \"test-curl-7357-5838f5\" (UID: \"14eca155-7c0d-4992-b227-dcbca885e728\") " pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:36.272326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.272292    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwzrc\" (UniqueName: \"kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc\") pod \"test-curl-7357-5838f5\" (UID: \"14eca155-7c0d-4992-b227-dcbca885e728\") " pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:36.326350 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.326310    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7357-a5a9d6" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" containerName="test-curl-7357-a5a9d6" containerID="cri-o://9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569" gracePeriod=2
Oct 31 00:37:36.375429 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:36.375378    5925 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7357-a5a9d6\" is forbidden: User \"system:node:ip-10-0-140-47.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-47.us-west-2.compute.internal' and this object" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:36.388740 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.388711    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:36.793328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:36.793241    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7357-5838f5"]
Oct 31 00:37:36.799047 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:36.799018    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14eca155_7c0d_4992_b227_dcbca885e728.slice/crio-fb8f58fcb58ee25cb14d5ae318e1536186119e5e1173513a9725c617ef8ac517 WatchSource:0}: Error finding container fb8f58fcb58ee25cb14d5ae318e1536186119e5e1173513a9725c617ef8ac517: Status 404 returned error can't find the container with id fb8f58fcb58ee25cb14d5ae318e1536186119e5e1173513a9725c617ef8ac517
Oct 31 00:37:37.333906 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:37.333870    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7357-5838f5" event={"ID":"14eca155-7c0d-4992-b227-dcbca885e728","Type":"ContainerStarted","Data":"7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56"}
Oct 31 00:37:37.334285 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:37.333918    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7357-5838f5" event={"ID":"14eca155-7c0d-4992-b227-dcbca885e728","Type":"ContainerStarted","Data":"fb8f58fcb58ee25cb14d5ae318e1536186119e5e1173513a9725c617ef8ac517"}
Oct 31 00:37:37.443103 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:37.443040    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7357-5838f5" podStartSLOduration=1.443021735 podStartE2EDuration="1.443021735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:37.442133111 +0000 UTC m=+1359.131013058" watchObservedRunningTime="2026-10-31 00:37:37.443021735 +0000 UTC m=+1359.131901683"
Oct 31 00:37:38.589793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:38.589769    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:38.638906 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:38.638874    5925 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7357-a5a9d6\" is forbidden: User \"system:node:ip-10-0-140-47.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-47.us-west-2.compute.internal' and this object" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:38.642408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:38.642381    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv\" (UniqueName: \"kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv\") pod \"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242\" (UID: \"f188ec53-50ff-4e3b-8a0f-5d9ca21dd242\") "
Oct 31 00:37:38.644605 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:38.644572    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv" pod "f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" (UID: "f188ec53-50ff-4e3b-8a0f-5d9ca21dd242"). InnerVolumeSpecName "kube-api-access-hrpqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:37:38.744140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:38.744106    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrpqv\" (UniqueName: \"kubernetes.io/projected/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242-kube-api-access-hrpqv\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:37:39.034568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.034493    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7357-5838f5"]
Oct 31 00:37:39.038017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.037987    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7357-5838f5"]
Oct 31 00:37:39.360292 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.360257    5925 generic.go:356] "Generic (PLEG): container finished" podID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" containerID="9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569" exitCode=137
Oct 31 00:37:39.360800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.360772    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7357-5838f5" podUID="14eca155-7c0d-4992-b227-dcbca885e728" containerName="test-curl-7357-5838f5" containerID="cri-o://7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56" gracePeriod=2
Oct 31 00:37:39.361014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.360315    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:39.361986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.360321    5925 scope.go:122] "RemoveContainer" containerID="9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569"
Oct 31 00:37:39.372648 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.372629    5925 scope.go:122] "RemoveContainer" containerID="9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569"
Oct 31 00:37:39.372928 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:39.372908    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569\": container with ID starting with 9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569 not found: ID does not exist" containerID="9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569"
Oct 31 00:37:39.372978 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:39.372940    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569"} err="failed to get container status \"9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569\": rpc error: code = NotFound desc = could not find container \"9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569\": container with ID starting with 9011761ee1a948dff50c909de923526b5e899f998267e108ce61222f9233a569 not found: ID does not exist"
Oct 31 00:37:39.411037 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:39.410999    5925 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7357-a5a9d6\" is forbidden: User \"system:node:ip-10-0-140-47.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-47.us-west-2.compute.internal' and this object" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:39.461799 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:39.461767    5925 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7357-5838f5\" is forbidden: User \"system:node:ip-10-0-140-47.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-47.us-west-2.compute.internal' and this object" podUID="14eca155-7c0d-4992-b227-dcbca885e728" pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:39.510634 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:39.510601    5925 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7357-a5a9d6\" is forbidden: User \"system:node:ip-10-0-140-47.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-47.us-west-2.compute.internal' and this object" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" pod="opendatahub/test-curl-7357-a5a9d6"
Oct 31 00:37:39.559576 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:39.559543    5925 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7357-5838f5\" is forbidden: User \"system:node:ip-10-0-140-47.us-west-2.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-47.us-west-2.compute.internal' and this object" podUID="14eca155-7c0d-4992-b227-dcbca885e728" pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:40.454783 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:40.454742    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f188ec53-50ff-4e3b-8a0f-5d9ca21dd242" path="/var/lib/kubelet/pods/f188ec53-50ff-4e3b-8a0f-5d9ca21dd242/volumes"
Oct 31 00:37:41.209437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.207014    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"]
Oct 31 00:37:41.216439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.216064    5925 cpu_manager.go:414] "containerMap: removing container" podUID="14eca155-7c0d-4992-b227-dcbca885e728" containerName="test-curl-7357-5838f5"
Oct 31 00:37:41.216439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.216094    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14eca155-7c0d-4992-b227-dcbca885e728" containerName="test-curl-7357-5838f5"
Oct 31 00:37:41.216439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.216327    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="14eca155-7c0d-4992-b227-dcbca885e728" containerName="test-curl-7357-5838f5"
Oct 31 00:37:41.222629 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.222600    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288173 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288136    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p92kr\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288332 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288254    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288332 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288287    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288401 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288383    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288408    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288472    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288504    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288622 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288605    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.288751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.288669    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.319654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.319621    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"]
Oct 31 00:37:41.342747 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.342713    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-26fb7237-gw-openshift-default-dockercfg-ph25x\""
Oct 31 00:37:41.390278 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390252    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390286    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390318    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390354    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390440    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390697 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390515    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390697 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390570    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p92kr\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390697 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390671    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390699    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390776    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.390849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.390833    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.391046 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.391024    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.391108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.391091    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.391471 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.391450    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.393086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.393062    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.393258 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.393240    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.451966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.451930    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.452600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.452567    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p92kr\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr\") pod \"e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") " pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.545787 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.545705    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:41.685230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.685196    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:41.822244 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.822174    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc\" (UniqueName: \"kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc\") pod \"14eca155-7c0d-4992-b227-dcbca885e728\" (UID: \"14eca155-7c0d-4992-b227-dcbca885e728\") "
Oct 31 00:37:41.824254 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.824230    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc" pod "14eca155-7c0d-4992-b227-dcbca885e728" (UID: "14eca155-7c0d-4992-b227-dcbca885e728"). InnerVolumeSpecName "kube-api-access-wwzrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:37:41.923574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:41.923540    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwzrc\" (UniqueName: \"kubernetes.io/projected/14eca155-7c0d-4992-b227-dcbca885e728-kube-api-access-wwzrc\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:37:42.002855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.002819    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"]
Oct 31 00:37:42.008337 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:42.008306    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf75e6bd_2e2f_4e26_9c58_d6e92012d0a8.slice/crio-d7e0121eb633523c3108115c6c8c360d11846e745ac8ca0c4a8f0305fb60c786 WatchSource:0}: Error finding container d7e0121eb633523c3108115c6c8c360d11846e745ac8ca0c4a8f0305fb60c786: Status 404 returned error can't find the container with id d7e0121eb633523c3108115c6c8c360d11846e745ac8ca0c4a8f0305fb60c786
Oct 31 00:37:42.010742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.010708    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:42.010845 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.010774    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:42.010845 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.010800    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:42.388044 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.387971    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" event={"ID":"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8","Type":"ContainerStarted","Data":"487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"}
Oct 31 00:37:42.388044 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.388037    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" event={"ID":"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8","Type":"ContainerStarted","Data":"d7e0121eb633523c3108115c6c8c360d11846e745ac8ca0c4a8f0305fb60c786"}
Oct 31 00:37:42.389668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.389639    5925 generic.go:356] "Generic (PLEG): container finished" podID="14eca155-7c0d-4992-b227-dcbca885e728" containerID="7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56" exitCode=137
Oct 31 00:37:42.389782 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.389678    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7357-5838f5"
Oct 31 00:37:42.389782 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.389737    5925 scope.go:122] "RemoveContainer" containerID="7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56"
Oct 31 00:37:42.401681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.401660    5925 scope.go:122] "RemoveContainer" containerID="7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56"
Oct 31 00:37:42.401978 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:42.401960    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56\": container with ID starting with 7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56 not found: ID does not exist" containerID="7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56"
Oct 31 00:37:42.402030 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.401987    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56"} err="failed to get container status \"7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56\": rpc error: code = NotFound desc = could not find container \"7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56\": container with ID starting with 7f5f1d321afc1924aafb464c1887753ad064e74f93dc84763e1fd7fc676d6c56 not found: ID does not exist"
Oct 31 00:37:42.453063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.453030    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14eca155-7c0d-4992-b227-dcbca885e728" path="/var/lib/kubelet/pods/14eca155-7c0d-4992-b227-dcbca885e728/volumes"
Oct 31 00:37:42.507228 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.507179    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podStartSLOduration=1.507165385 podStartE2EDuration="1.507165385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:42.505518396 +0000 UTC m=+1364.194398344" watchObservedRunningTime="2026-10-31 00:37:42.507165385 +0000 UTC m=+1364.196045331"
Oct 31 00:37:42.547381 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:42.547354    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:43.552312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:43.552280    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:44.414132 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.414091    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:44.415616 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.415591    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:37:44.465228 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.465199    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"]
Oct 31 00:37:44.468856 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.468834    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.512962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.512930    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"]
Oct 31 00:37:44.516565 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.516546    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.562609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.562575    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"]
Oct 31 00:37:44.566218 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566188    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92pnr\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566246    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566306    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566353 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566336    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566478    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566520    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566625    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566721 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566670    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.566801 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.566779    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.570625 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.570602    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e7b593fa-openshift-default-dockercfg-kr7c9\""
Oct 31 00:37:44.634448 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.630346    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"]
Oct 31 00:37:44.668237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668155    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668203    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668237    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668266    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668287    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668310    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668327    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668357    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92pnr\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668371    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668397    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668450    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668489    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668508    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.668546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668534    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.669184 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668600    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.669184 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.668627    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.669590 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.669556    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.669705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.669608    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mngx\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.669705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.669693    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.670026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.669998    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.670333 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.670309    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.670593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.670565    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.671049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.671029    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.674691 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.674670    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.685671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.685642    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.727962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.727933    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.728110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.728089    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92pnr\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr\") pod \"e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") " pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772158    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772315    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772350    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mngx\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772456    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772508    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772590    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772636    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772694    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.772748    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.773264    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.774476 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.773546    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.775256 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.774840    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.779928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.777535    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.779928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.778286    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.782671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.781987    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.782671 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.782318    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:44.784331 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.784304    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.834539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.834502    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:44.834730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:44.834580    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mngx\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx\") pod \"e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") " pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:45.131790 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.131764    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:45.234236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.234192    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"]
Oct 31 00:37:45.238954 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:45.238924    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d28b4f_7a5f_461f_a678_2f892711f2b1.slice/crio-14e91e04a9f16a56a0ffe794a64065a4494be3a96bc99adb48f1c057e7852f99 WatchSource:0}: Error finding container 14e91e04a9f16a56a0ffe794a64065a4494be3a96bc99adb48f1c057e7852f99: Status 404 returned error can't find the container with id 14e91e04a9f16a56a0ffe794a64065a4494be3a96bc99adb48f1c057e7852f99
Oct 31 00:37:45.241718 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.241682    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:45.241824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.241747    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:45.241824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.241775    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:45.422429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.422315    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" event={"ID":"50d28b4f-7a5f-461f-a678-2f892711f2b1","Type":"ContainerStarted","Data":"e843be3deabc6febe68b9521d112df97ad2d0c892cae0fbd70c2c5f2a02b1595"}
Oct 31 00:37:45.422429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.422393    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" event={"ID":"50d28b4f-7a5f-461f-a678-2f892711f2b1","Type":"ContainerStarted","Data":"14e91e04a9f16a56a0ffe794a64065a4494be3a96bc99adb48f1c057e7852f99"}
Oct 31 00:37:45.515492 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.515450    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"]
Oct 31 00:37:45.520104 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:45.520080    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c732995_6029_4280_a503_4afc55ad7034.slice/crio-8dd0e14c302ef37da7a6510ad6f1a6b20c0159ba487cb3b19c59db09e006edc2 WatchSource:0}: Error finding container 8dd0e14c302ef37da7a6510ad6f1a6b20c0159ba487cb3b19c59db09e006edc2: Status 404 returned error can't find the container with id 8dd0e14c302ef37da7a6510ad6f1a6b20c0159ba487cb3b19c59db09e006edc2
Oct 31 00:37:45.522749 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.522716    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:45.522818 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.522777    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:45.522818 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.522805    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:45.545252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.545201    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podStartSLOduration=1.5451828490000001 podStartE2EDuration="1.545182849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:45.544312773 +0000 UTC m=+1367.233192722" watchObservedRunningTime="2026-10-31 00:37:45.545182849 +0000 UTC m=+1367.234062796"
Oct 31 00:37:45.782780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:45.782683    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:46.432345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:46.432302    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" event={"ID":"8c732995-6029-4280-a503-4afc55ad7034","Type":"ContainerStarted","Data":"ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"}
Oct 31 00:37:46.432559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:46.432369    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" event={"ID":"8c732995-6029-4280-a503-4afc55ad7034","Type":"ContainerStarted","Data":"8dd0e14c302ef37da7a6510ad6f1a6b20c0159ba487cb3b19c59db09e006edc2"}
Oct 31 00:37:46.562437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:46.562059    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podStartSLOduration=2.562039316 podStartE2EDuration="2.562039316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:46.561189655 +0000 UTC m=+1368.250069602" watchObservedRunningTime="2026-10-31 00:37:46.562039316 +0000 UTC m=+1368.250919263"
Oct 31 00:37:46.580307 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:37:46.580267    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:37:46.784217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:46.784131    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 00:37:46.784217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:46.784196    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 00:37:47.132456 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:47.132425    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:47.138449 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:47.138380    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:47.449495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:47.447532    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:47.466448 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:47.458696    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:37:47.782844 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:47.782766    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 00:37:47.783041 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:47.783016    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 00:37:48.545385 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.545313    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"]
Oct 31 00:37:48.552092 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.552067    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.628245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.628205    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.628514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.628492    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.628713 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.628692    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.633434 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.630076    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.633640 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.633619    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.642434 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.633804    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.642667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.642642    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6m7p\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.642825 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.642810    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.643018 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.643003    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.658238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.658207    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-49bb6b1a-openshift-default-dockercfg-rdd92\""
Oct 31 00:37:48.795524 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.779834    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.796390 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.796356    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.820993    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.821061    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6m7p\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.821127    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.821239    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.821296    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.821336    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.821401    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.780402    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.822344    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 00:37:48.822453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.822407    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 00:37:48.825555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.823577    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.825555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.824406    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.825555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.825297    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"]
Oct 31 00:37:48.826010 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.825983    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.826133 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.825983    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.829816 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.829793    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.830141 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.830120    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.882087 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.881510    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.882897 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.882732    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6m7p\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p\") pod \"e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") " pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:48.910247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:48.910208    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:49.385136 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.385100    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"]
Oct 31 00:37:49.390936 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:49.390521    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e85b04_c739_4ae9_b83e_de3c61b46c55.slice/crio-bafbbe609525eb5e767c45184cc8a25be4731c53fab4d285fd2e9fcf11c46c8f WatchSource:0}: Error finding container bafbbe609525eb5e767c45184cc8a25be4731c53fab4d285fd2e9fcf11c46c8f: Status 404 returned error can't find the container with id bafbbe609525eb5e767c45184cc8a25be4731c53fab4d285fd2e9fcf11c46c8f
Oct 31 00:37:49.393483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.393225    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:49.393483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.393318    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:49.393483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.393363    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:49.496751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.496725    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" event={"ID":"93e85b04-c739-4ae9-b83e-de3c61b46c55","Type":"ContainerStarted","Data":"bafbbe609525eb5e767c45184cc8a25be4731c53fab4d285fd2e9fcf11c46c8f"}
Oct 31 00:37:49.786508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.783547    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 00:37:49.786508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:49.783625    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 00:37:50.506895 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:50.506861    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" event={"ID":"93e85b04-c739-4ae9-b83e-de3c61b46c55","Type":"ContainerStarted","Data":"9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"}
Oct 31 00:37:50.693765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:50.693696    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podStartSLOduration=2.693673009 podStartE2EDuration="2.693673009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:50.648695778 +0000 UTC m=+1372.337575724" watchObservedRunningTime="2026-10-31 00:37:50.693673009 +0000 UTC m=+1372.382552957"
Oct 31 00:37:50.787497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:50.785000    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 00:37:50.787497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:50.785121    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 00:37:50.911224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:50.911194    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:50.916210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:50.916184    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:51.517574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:51.517543    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:51.518519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:51.518497    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:37:51.791496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:51.790963    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 00:37:51.791496 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:51.791028    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 00:37:52.831043 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:52.831013    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:52.831631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:52.831426    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:52.832081 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:52.832060    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:37:57.767647 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.767612    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"]
Oct 31 00:37:57.772917 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.772892    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.833672 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.833643    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.833855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.833687    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.833855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.833804    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.833982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.833886    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.833982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.833968    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qtch\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.834053 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.833995    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.834053 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.834042    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.834126 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.834070    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.834160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.834122    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.873134 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.873080    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"]
Oct 31 00:37:57.935399 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935367    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935438    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qtch\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935460    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935496    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935514    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935557    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935628    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935680    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935744    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.935891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935870    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.936030 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.935957    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.936241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.936216    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.936346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.936319    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.936499 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.936462    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.938000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.937979    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.938299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.938280    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.997988 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.997955    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:57.998121 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:57.998025    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qtch\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:58.092643 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:58.092609    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:37:58.592402 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:58.592368    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"]
Oct 31 00:37:58.596049 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:37:58.596023    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083fe01c_e7f8_43e5_9c89_d4537eac88a5.slice/crio-e1ba8052995e7b70ef07693a9d0b8c4cd185f7721a28ff850f1f20389c29c67b WatchSource:0}: Error finding container e1ba8052995e7b70ef07693a9d0b8c4cd185f7721a28ff850f1f20389c29c67b: Status 404 returned error can't find the container with id e1ba8052995e7b70ef07693a9d0b8c4cd185f7721a28ff850f1f20389c29c67b
Oct 31 00:37:58.598625 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:58.598593    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:58.598710 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:58.598656    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:58.598710 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:58.598685    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:37:59.590332 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:59.590289    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" event={"ID":"083fe01c-e7f8-43e5-9c89-d4537eac88a5","Type":"ContainerStarted","Data":"362abc5056e0fb5c9c8eb81c3abb0a234611d2f15157b49eb01211d247c72eb9"}
Oct 31 00:37:59.590984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:37:59.590950    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" event={"ID":"083fe01c-e7f8-43e5-9c89-d4537eac88a5","Type":"ContainerStarted","Data":"e1ba8052995e7b70ef07693a9d0b8c4cd185f7721a28ff850f1f20389c29c67b"}
Oct 31 00:38:00.093472 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:00.093440    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:38:00.094851 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:00.094825    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:00.094998 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:00.094880    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:01.093891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:01.093855    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:01.094549 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:01.094466    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:02.093464 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:02.093404    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:02.093661 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:02.093489    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:03.095014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:03.094975    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:03.095681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:03.095628    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:04.096936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:04.096899    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:04.098382 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:04.098348    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:04.438609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:04.438513    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:04.603596 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:04.603535    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:05.064443 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:05.062182    5925 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/health\": context deadline exceeded"
Oct 31 00:38:05.106446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:05.098588    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:05.106446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:05.099947    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:05.106446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:05.099997    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:06.093202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:06.093165    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 31 00:38:06.093361 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:06.093232    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 31 00:38:07.097743 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:07.097707    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:38:07.098256 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:07.098242    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:38:07.099176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:07.099151    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:38:07.299865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:07.299801    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podStartSLOduration=10.299782689 podStartE2EDuration="10.299782689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:37:59.764762974 +0000 UTC m=+1381.453642921" watchObservedRunningTime="2026-10-31 00:38:07.299782689 +0000 UTC m=+1388.988662636"
Oct 31 00:38:13.885156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.885123    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"]
Oct 31 00:38:13.888664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.888636    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.959552 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.959521    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"]
Oct 31 00:38:13.989683 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.989633    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.989974 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.989953    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990190 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990170    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990392 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990369    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbjrq\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990509 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990462    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990540    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990604    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990697 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990657    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:13.990750 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:13.990700    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.075181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.075139    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"]
Oct 31 00:38:14.079555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.079531    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.092500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092476    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.092604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092507    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.092604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092525    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.092604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092540    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.092604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092572    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.092839 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092711    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.092839 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092752    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.092839 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092768    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.092839 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092810    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092844    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092868    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092892    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092933    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.092942    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093016    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093046    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.093400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093138    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093164    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmw7w\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.093400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093166    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093263    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093288    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbjrq\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093690 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093443    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.093793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.093770    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.095164 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.095146    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.095507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.095485    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.135626 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.135557    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"]
Oct 31 00:38:14.161835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.161803    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.165278 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.162040    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbjrq\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq\") pod \"e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") " pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.194177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194143    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194318 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194187    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194318 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194218    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194318 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194245    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194318 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194285    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194382    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194453    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194546    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.194777 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.194629    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmw7w\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.195564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.195515    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.195675 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.195606    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.195825 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.195806    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.198688 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.198343    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.201059 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.201034    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.201356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.201334    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.202210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.202190    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:14.203151 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.203127    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.253722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.253671    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.253896 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.253874    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmw7w\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.395196 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.394963    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:14.481970 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.479566    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"]
Oct 31 00:38:14.488322 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.488299    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.540140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.540105    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"]
Oct 31 00:38:14.579483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.579452    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 31 00:38:14.579669 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.579543    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 31 00:38:14.579669 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.579595    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pbwgm\""
Oct 31 00:38:14.579669 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.579615    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 31 00:38:14.600144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600116    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.600281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600157    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.600281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600268    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.600393 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600374    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.600451 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600439    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.600549 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600535    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.600583 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.600576    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l569f\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.651121 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.651023    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"]
Oct 31 00:38:14.660327 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:38:14.660300    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03aae54_4e55_43fa_a27b_f520babe5576.slice/crio-03a3e982c34fd25f92724afc89c34e2c461ebde6dd8f2ef1efcdfd668010155f WatchSource:0}: Error finding container 03a3e982c34fd25f92724afc89c34e2c461ebde6dd8f2ef1efcdfd668010155f: Status 404 returned error can't find the container with id 03a3e982c34fd25f92724afc89c34e2c461ebde6dd8f2ef1efcdfd668010155f
Oct 31 00:38:14.662526 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.662491    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:14.662637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.662571    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:14.662637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.662613    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:14.701426 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701391    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.701536 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701515    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.701604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701564    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.701662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701634    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.701713 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701672    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.701769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701740    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.701842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.701767    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l569f\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.702214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.702186    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.703897 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.703879    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.705136 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.705115    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.705214 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.705149    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.705255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.705211    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.760486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.760461    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.763122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.763097    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l569f\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f\") pod \"istiod-openshift-gateway-7ddd9cfdc8-xjq9h\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:14.790047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.790017    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"]
Oct 31 00:38:14.790758 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:38:14.790363    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2174b6fa_8559_4333_8748_442074cd5941.slice/crio-6a2af668ad863b43a9a9659005350c2e633711f6eb3226f0b2c77f6f45edfa8c WatchSource:0}: Error finding container 6a2af668ad863b43a9a9659005350c2e633711f6eb3226f0b2c77f6f45edfa8c: Status 404 returned error can't find the container with id 6a2af668ad863b43a9a9659005350c2e633711f6eb3226f0b2c77f6f45edfa8c
Oct 31 00:38:14.792724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.792688    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:14.792913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.792890    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:14.793061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.793041    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:14.802860 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:14.802835    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:15.011920 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.011788    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" event={"ID":"2174b6fa-8559-4333-8748-442074cd5941","Type":"ContainerStarted","Data":"24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a"}
Oct 31 00:38:15.011920 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.011847    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" event={"ID":"2174b6fa-8559-4333-8748-442074cd5941","Type":"ContainerStarted","Data":"6a2af668ad863b43a9a9659005350c2e633711f6eb3226f0b2c77f6f45edfa8c"}
Oct 31 00:38:15.013860 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.013837    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" event={"ID":"d03aae54-4e55-43fa-a27b-f520babe5576","Type":"ContainerStarted","Data":"ea5546cc29b79301f42c22f2bcb472a5d0fe7390101b8519dc15d78b5a2428c4"}
Oct 31 00:38:15.013941 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.013879    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" event={"ID":"d03aae54-4e55-43fa-a27b-f520babe5576","Type":"ContainerStarted","Data":"03a3e982c34fd25f92724afc89c34e2c461ebde6dd8f2ef1efcdfd668010155f"}
Oct 31 00:38:15.130804 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.130751    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podStartSLOduration=1.130738489 podStartE2EDuration="1.130738489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:15.127265911 +0000 UTC m=+1396.816145860" watchObservedRunningTime="2026-10-31 00:38:15.130738489 +0000 UTC m=+1396.819618433"
Oct 31 00:38:15.202485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.202457    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:15.204500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.204461    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:15.204634 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.204527    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:15.217521 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.217492    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"]
Oct 31 00:38:15.222238 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:38:15.222206    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8534c332_459c_4aa9_bdb0_f329a6463f7e.slice/crio-06012d93c84e6fd8c2339474126779cc5c7ec33eb3eb00268fdf9b842d19dfa8 WatchSource:0}: Error finding container 06012d93c84e6fd8c2339474126779cc5c7ec33eb3eb00268fdf9b842d19dfa8: Status 404 returned error can't find the container with id 06012d93c84e6fd8c2339474126779cc5c7ec33eb3eb00268fdf9b842d19dfa8
Oct 31 00:38:15.248172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.248119    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podStartSLOduration=2.248103027 podStartE2EDuration="2.248103027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:15.246357151 +0000 UTC m=+1396.935237106" watchObservedRunningTime="2026-10-31 00:38:15.248103027 +0000 UTC m=+1396.936982971"
Oct 31 00:38:15.395079 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.395028    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:15.396678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.396639    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:15.396798 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:15.396695    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:16.022884 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:16.022849    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" event={"ID":"8534c332-459c-4aa9-bdb0-f329a6463f7e","Type":"ContainerStarted","Data":"06012d93c84e6fd8c2339474126779cc5c7ec33eb3eb00268fdf9b842d19dfa8"}
Oct 31 00:38:16.205363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:16.205325    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:16.205610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:16.205493    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:16.401438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:16.400923    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:16.401438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:16.400999    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:16.615437 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:38:16.615292    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:38:17.204470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:17.203856    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:17.204470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:17.203920    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:17.401436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:17.398003    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:17.401436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:17.398064    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:18.215465 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:18.206808    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:18.215465 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:18.206866    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:18.402368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:18.401803    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:18.402368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:18.401866    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:19.205438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:19.203986    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:19.205438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:19.204057    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:19.401907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:19.401775    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:19.401907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:19.401842    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:20.203785 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:20.203739    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:20.204006 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:20.203808    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:20.396854 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:20.396813    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:20.397172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:20.397127    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:21.203347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:21.203310    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 00:38:21.203890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:21.203371    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 00:38:21.396164 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:21.396119    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 00:38:21.396348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:21.396185    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 00:38:22.384918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:22.384002    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:22.384918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:22.384670    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:22.386160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:22.386102    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:38:22.792105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:22.792012    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:22.794058 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:22.794030    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:22.797086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:22.797064    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:38:23.427907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:23.427875    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:23.428209 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:23.427936    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:24.168988 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:24.168951    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" event={"ID":"8534c332-459c-4aa9-bdb0-f329a6463f7e","Type":"ContainerStarted","Data":"e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f"}
Oct 31 00:38:24.169158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:24.169009    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:24.170622 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:24.170591    5925 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-xjq9h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:38:24.170760 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:24.170640    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:38:24.366351 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:24.366303    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" podStartSLOduration=2.1645523349999998 podStartE2EDuration="10.366289532s" totalImagesPullingTime="8.201737197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:24.366024578 +0000 UTC m=+1406.054904521" watchObservedRunningTime="2026-10-31 00:38:24.366289532 +0000 UTC m=+1406.055169475"
Oct 31 00:38:25.176228 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:25.176197    5925 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-xjq9h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:38:25.176628 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:25.176259    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:38:28.176324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:28.176293    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:38:46.634576 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:38:46.633553    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:38:48.141615 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:48.141556    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:48.165112 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:48.165060    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:48.377532 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:48.371837    5925 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/health\": context deadline exceeded"
Oct 31 00:38:48.434751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:48.434646    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:48.599531 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:48.599483    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.84:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:49.444557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:49.444515    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:38:49.445266 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:49.445234    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:38:57.581102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:57.581004    5925 generic.go:356] "Generic (PLEG): container finished" podID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerID="487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9" exitCode=0
Oct 31 00:38:57.581102 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:57.581071    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" event={"ID":"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8","Type":"ContainerDied","Data":"487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"}
Oct 31 00:38:57.581591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:57.581486    5925 scope.go:122] "RemoveContainer" containerID="487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"
Oct 31 00:38:57.582995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:57.582961    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:57.583132 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:57.583046    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:57.583132 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:57.583095    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:38:58.591044 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:58.591002    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" event={"ID":"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8","Type":"ContainerStarted","Data":"051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b"}
Oct 31 00:38:59.414369 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:59.414285    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:38:59.565602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:59.565566    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:38:59.567211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:59.567185    5925 patch_prober.go:29] interesting pod/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 00:38:59.567425 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:38:59.567383    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 00:39:00.562439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:00.560269    5925 patch_prober.go:29] interesting pod/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 00:39:00.562439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:00.560343    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 00:39:01.565088 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:01.565050    5925 patch_prober.go:29] interesting pod/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 00:39:01.565774 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:01.565740    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 00:39:02.563018 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:02.561865    5925 patch_prober.go:29] interesting pod/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 00:39:02.563018 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:02.561932    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 00:39:03.550800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:03.550758    5925 patch_prober.go:29] interesting pod/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 00:39:03.551615 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:03.551583    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 00:39:04.553199 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:04.553162    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:39:04.555073 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:04.555049    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:39:14.495495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.495400    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"]
Oct 31 00:39:14.498847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.498828    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.534915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.534877    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95m9x\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.535101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.534997    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.535101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.535047    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.535101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.535075    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.535552 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.535521    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.538264 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.538241    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.538497 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.538285    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.538585 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.538489    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.538585 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.538547    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640083    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640145    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640236    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640281    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640374    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95m9x\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640407    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640481    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640503    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640738 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640579    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.640738 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.640601    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.641068 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.641042    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.641333 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.641308    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.641574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.641550    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.642336 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.642312    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.644400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.644342    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.650261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.650241    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.699891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.699846    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"]
Oct 31 00:39:14.710706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.707652    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95m9x\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.713966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.713933    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token\") pod \"e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") " pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:14.812288 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:14.812207    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:15.320834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.320799    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"]
Oct 31 00:39:15.326127 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:39:15.326097    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e94dd20_7028_473e_8033_42050f7395b4.slice/crio-dec2365753865373b5372d2536258f40980fabd8a13692d83fd50489dbd8821b WatchSource:0}: Error finding container dec2365753865373b5372d2536258f40980fabd8a13692d83fd50489dbd8821b: Status 404 returned error can't find the container with id dec2365753865373b5372d2536258f40980fabd8a13692d83fd50489dbd8821b
Oct 31 00:39:15.328807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.328775    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:15.328890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.328846    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:15.328890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.328875    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:15.737834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.737798    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" event={"ID":"6e94dd20-7028-473e-8033-42050f7395b4","Type":"ContainerStarted","Data":"370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f"}
Oct 31 00:39:15.738216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.737888    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" event={"ID":"6e94dd20-7028-473e-8033-42050f7395b4","Type":"ContainerStarted","Data":"dec2365753865373b5372d2536258f40980fabd8a13692d83fd50489dbd8821b"}
Oct 31 00:39:15.812974 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.812932    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:15.860092 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:15.860038    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podStartSLOduration=1.860025 podStartE2EDuration="1.860025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:15.856508144 +0000 UTC m=+1457.545388096" watchObservedRunningTime="2026-10-31 00:39:15.860025 +0000 UTC m=+1457.548904946"
Oct 31 00:39:16.585637 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:39:16.585591    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:39:16.814342 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:16.814310    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:16.814759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:16.814363    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:17.813031 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:17.812994    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:17.813216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:17.813063    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:18.813440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:18.813337    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:18.813828 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:18.813434    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:19.818544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:19.815716    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:19.818544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:19.815782    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:20.813437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:20.812873    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:20.813437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:20.812976    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:21.813439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:21.812773    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:21.813439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:21.812825    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:22.813453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:22.812860    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 31 00:39:22.813453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:22.812925    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 31 00:39:23.985503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:23.983846    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:23.985503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:23.985323    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:23.998446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:23.997780    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:39:33.019752 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:33.011700    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": read tcp 10.132.0.2:39120->10.132.0.93:15021: read: connection reset by peer" start-of-body=
Oct 31 00:39:33.019752 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:33.011780    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": read tcp 10.132.0.2:39120->10.132.0.93:15021: read: connection reset by peer"
Oct 31 00:39:34.066848 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.066816    5925 generic.go:356] "Generic (PLEG): container finished" podID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerID="9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc" exitCode=0
Oct 31 00:39:34.067274 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.066888    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" event={"ID":"93e85b04-c739-4ae9-b83e-de3c61b46c55","Type":"ContainerDied","Data":"9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"}
Oct 31 00:39:34.067366 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.067350    5925 scope.go:122] "RemoveContainer" containerID="9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"
Oct 31 00:39:34.068767 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.068738    5925 generic.go:356] "Generic (PLEG): container finished" podID="8c732995-6029-4280-a503-4afc55ad7034" containerID="ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921" exitCode=0
Oct 31 00:39:34.068875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.068805    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" event={"ID":"8c732995-6029-4280-a503-4afc55ad7034","Type":"ContainerDied","Data":"ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"}
Oct 31 00:39:34.069090 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.069065    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:34.069144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.069132    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:34.069180 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.069163    5925 scope.go:122] "RemoveContainer" containerID="ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"
Oct 31 00:39:34.069246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.069166    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:34.071793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.071744    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:34.071940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.071915    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:34.072045 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:34.072022    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:39:35.104247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.104204    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" event={"ID":"93e85b04-c739-4ae9-b83e-de3c61b46c55","Type":"ContainerStarted","Data":"106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349"}
Oct 31 00:39:35.108892 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.108856    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" event={"ID":"8c732995-6029-4280-a503-4afc55ad7034","Type":"ContainerStarted","Data":"17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791"}
Oct 31 00:39:35.132221 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.132186    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:39:35.132536 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.132444    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 00:39:35.132733 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.132712    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 00:39:35.912254 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.911365    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:39:35.912512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.912485    5925 patch_prober.go:29] interesting pod/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 00:39:35.912597 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:35.912573    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 00:39:36.132567 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:36.132533    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 00:39:36.132951 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:36.132590    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 00:39:36.517462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:36.517403    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:39:36.911509 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:36.911471    5925 patch_prober.go:29] interesting pod/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 00:39:36.911716 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:36.911527    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 00:39:37.132447 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:37.132369    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 00:39:37.132663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:37.132450    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 00:39:37.911641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:37.911594    5925 patch_prober.go:29] interesting pod/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 00:39:37.911872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:37.911669    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 00:39:38.132364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:38.132328    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 00:39:38.132562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:38.132395    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 00:39:38.911290 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:38.911253    5925 patch_prober.go:29] interesting pod/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 00:39:38.911748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:38.911327    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 00:39:39.133154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:39.133103    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 00:39:39.133379 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:39.133174    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 00:39:39.911017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:39.910975    5925 patch_prober.go:29] interesting pod/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 00:39:39.911206 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:39.911030    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 00:39:40.132458 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:40.132425    5925 patch_prober.go:29] interesting pod/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 00:39:40.132933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:40.132497    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 00:39:40.918002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:40.917961    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:39:40.919111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:40.919083    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:39:41.136834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:41.136806    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:39:41.137245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:41.137109    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:39:41.137766 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:41.137749    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:39:46.630139 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:39:46.630099    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:39:58.708984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:58.708952    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:39:58.712583 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:39:58.712557    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:40:16.544577 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:16.544536    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:40:24.737138 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:24.737101    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"]
Oct 31 00:40:24.737652 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:24.737301    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy" containerID="cri-o://051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b" gracePeriod=30
Oct 31 00:40:30.235513 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.235480    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:40:30.428167 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428087    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428410 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428386    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428517 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428402    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:30.428588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428526    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428643 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428610    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428710 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428671    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428766 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428717    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428766 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428755    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428858 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428804    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:30.428927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428870    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.428927 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.428907    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs\") pod \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\" (UID: \"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8\") "
Oct 31 00:40:30.429522 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.429490    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.429522 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.429524    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.429772 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.429732    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:30.429772 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.429752    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:30.429944 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.429919    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:40:30.432395 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.432365    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "kube-api-access-p92kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:30.432511 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.432472    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:30.435643 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.435619    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:40:30.436475 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.436448    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token" pod "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" (UID: "df75e6bd-2e2f-4e26-9c58-d6e92012d0a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:30.530954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.530916    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.530954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.530946    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.530954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.530960    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.531251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.530975    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.531251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.530988    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p92kr\" (UniqueName: \"kubernetes.io/projected/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-kube-api-access-p92kr\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.531251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.530999    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.531251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.531012    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:30.615811 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.615774    5925 generic.go:356] "Generic (PLEG): container finished" podID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerID="051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b" exitCode=0
Oct 31 00:40:30.615995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.615828    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"
Oct 31 00:40:30.615995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.615850    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" event={"ID":"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8","Type":"ContainerDied","Data":"051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b"}
Oct 31 00:40:30.615995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.615906    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n" event={"ID":"df75e6bd-2e2f-4e26-9c58-d6e92012d0a8","Type":"ContainerDied","Data":"d7e0121eb633523c3108115c6c8c360d11846e745ac8ca0c4a8f0305fb60c786"}
Oct 31 00:40:30.615995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.615933    5925 scope.go:122] "RemoveContainer" containerID="051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b"
Oct 31 00:40:30.630108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.630083    5925 scope.go:122] "RemoveContainer" containerID="487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"
Oct 31 00:40:30.640621 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.640586    5925 scope.go:122] "RemoveContainer" containerID="051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b"
Oct 31 00:40:30.640910 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:30.640888    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b\": container with ID starting with 051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b not found: ID does not exist" containerID="051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b"
Oct 31 00:40:30.641017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.640919    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b"} err="failed to get container status \"051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b\": rpc error: code = NotFound desc = could not find container \"051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b\": container with ID starting with 051e8786e93748281c0c5d99ec158113fbeae32764e7cd0b03da24ebf7ea9a1b not found: ID does not exist"
Oct 31 00:40:30.641017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.640941    5925 scope.go:122] "RemoveContainer" containerID="487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"
Oct 31 00:40:30.641219 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:30.641202    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9\": container with ID starting with 487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9 not found: ID does not exist" containerID="487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"
Oct 31 00:40:30.641257 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.641224    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9"} err="failed to get container status \"487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9\": rpc error: code = NotFound desc = could not find container \"487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9\": container with ID starting with 487e9084c677546f73259b9f1236b020f81dc4a640eab95217a2b6420fe37bf9 not found: ID does not exist"
Oct 31 00:40:30.781042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.780955    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"]
Oct 31 00:40:30.786091 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:30.786066    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-26fb7237-gw-openshift-default-85889546d5-9fm2n"]
Oct 31 00:40:31.998070 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:31.998035    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"]
Oct 31 00:40:31.998501 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:31.998302    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy" containerID="cri-o://17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791" gracePeriod=30
Oct 31 00:40:32.453915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:32.453873    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" path="/var/lib/kubelet/pods/df75e6bd-2e2f-4e26-9c58-d6e92012d0a8/volumes"
Oct 31 00:40:37.659386 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.649840    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:40:37.760962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.760921    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.761181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761046    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.761181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761097    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.761181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761150    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.761373 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761292    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.761479 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761389    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.761479 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761440    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.762904 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.762881    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.763049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.762941    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy\") pod \"8c732995-6029-4280-a503-4afc55ad7034\" (UID: \"8c732995-6029-4280-a503-4afc55ad7034\") "
Oct 31 00:40:37.763494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.761925    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:37.763494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.762099    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:37.763494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.762133    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:40:37.763494 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.762601    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:37.763770 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.762772    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:37.765603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.765575    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "kube-api-access-9mngx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:37.765761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.765732    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:40:37.784853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.784775    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:37.798728 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.797534    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy" pod "8c732995-6029-4280-a503-4afc55ad7034" (UID: "8c732995-6029-4280-a503-4afc55ad7034"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:37.810238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.810193    5925 generic.go:356] "Generic (PLEG): container finished" podID="8c732995-6029-4280-a503-4afc55ad7034" containerID="17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791" exitCode=0
Oct 31 00:40:37.810359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.810260    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"
Oct 31 00:40:37.810462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.810408    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" event={"ID":"8c732995-6029-4280-a503-4afc55ad7034","Type":"ContainerDied","Data":"17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791"}
Oct 31 00:40:37.810528 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.810515    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7" event={"ID":"8c732995-6029-4280-a503-4afc55ad7034","Type":"ContainerDied","Data":"8dd0e14c302ef37da7a6510ad6f1a6b20c0159ba487cb3b19c59db09e006edc2"}
Oct 31 00:40:37.810584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.810567    5925 scope.go:122] "RemoveContainer" containerID="17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791"
Oct 31 00:40:37.844593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.844561    5925 scope.go:122] "RemoveContainer" containerID="ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"
Oct 31 00:40:37.870380 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.870349    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871035    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mngx\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-kube-api-access-9mngx\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871195 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871180    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c732995-6029-4280-a503-4afc55ad7034-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871311    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871461 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871447    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871590    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c732995-6029-4280-a503-4afc55ad7034-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871740 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871726    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c732995-6029-4280-a503-4afc55ad7034-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871838    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.871962 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871949    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c732995-6029-4280-a503-4afc55ad7034-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:37.872050 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.871102    5925 scope.go:122] "RemoveContainer" containerID="17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791"
Oct 31 00:40:37.872876 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:37.872821    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791\": container with ID starting with 17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791 not found: ID does not exist" containerID="17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791"
Oct 31 00:40:37.872987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.872885    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791"} err="failed to get container status \"17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791\": rpc error: code = NotFound desc = could not find container \"17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791\": container with ID starting with 17ca9cd9f17b2a1bcb9aa3839d8d707da1fd3b930d9145e9e871a6ed4d8a6791 not found: ID does not exist"
Oct 31 00:40:37.872987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.872933    5925 scope.go:122] "RemoveContainer" containerID="ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"
Oct 31 00:40:37.873454 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:37.873390    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921\": container with ID starting with ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921 not found: ID does not exist" containerID="ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"
Oct 31 00:40:37.873549 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.873464    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921"} err="failed to get container status \"ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921\": rpc error: code = NotFound desc = could not find container \"ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921\": container with ID starting with ecf86ca50dbde273b5970f5eb2d3553b4fdd30070c78e7336bebdfac16237921 not found: ID does not exist"
Oct 31 00:40:37.988491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.988069    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"]
Oct 31 00:40:38.005002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:37.996146    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e7b593fa-openshift-default-655485f877-v8fd7"]
Oct 31 00:40:38.457393 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:38.457350    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c732995-6029-4280-a503-4afc55ad7034" path="/var/lib/kubelet/pods/8c732995-6029-4280-a503-4afc55ad7034/volumes"
Oct 31 00:40:39.068396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:39.068360    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"]
Oct 31 00:40:39.068917 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:39.068638    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" containerID="cri-o://106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349" gracePeriod=30
Oct 31 00:40:40.920598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:40.920561    5925 patch_prober.go:29] interesting pod/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:40:40.920990 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:40.920623    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:40:44.418681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.418655    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:40:44.491203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491172    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491233    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491290    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491361    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491532 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491424    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491532 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491455    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491532 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491502    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491683 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491531    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491683 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491579    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo\") pod \"93e85b04-c739-4ae9-b83e-de3c61b46c55\" (UID: \"93e85b04-c739-4ae9-b83e-de3c61b46c55\") "
Oct 31 00:40:44.491806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491575    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:40:44.491868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491693    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:44.491868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491705    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:44.491868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491833    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:44.492000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.491855    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:44.492367 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.492341    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.492539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.492370    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.492539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.492387    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.492539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.492401    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.492539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.492457    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e85b04-c739-4ae9-b83e-de3c61b46c55-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.493614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.493592    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:40:44.493883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.493858    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:44.494144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.494125    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:40:44.494144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.494132    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p" pod "93e85b04-c739-4ae9-b83e-de3c61b46c55" (UID: "93e85b04-c739-4ae9-b83e-de3c61b46c55"). InnerVolumeSpecName "kube-api-access-v6m7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:44.593786 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.593757    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.593786 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.593783    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.593786 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.593792    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6m7p\" (UniqueName: \"kubernetes.io/projected/93e85b04-c739-4ae9-b83e-de3c61b46c55-kube-api-access-v6m7p\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.594065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.593803    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e85b04-c739-4ae9-b83e-de3c61b46c55-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:44.868792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.868752    5925 generic.go:356] "Generic (PLEG): container finished" podID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerID="106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349" exitCode=0
Oct 31 00:40:44.868975 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.868800    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" event={"ID":"93e85b04-c739-4ae9-b83e-de3c61b46c55","Type":"ContainerDied","Data":"106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349"}
Oct 31 00:40:44.868975 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.868817    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"
Oct 31 00:40:44.868975 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.868869    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs" event={"ID":"93e85b04-c739-4ae9-b83e-de3c61b46c55","Type":"ContainerDied","Data":"bafbbe609525eb5e767c45184cc8a25be4731c53fab4d285fd2e9fcf11c46c8f"}
Oct 31 00:40:44.868975 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.868899    5925 scope.go:122] "RemoveContainer" containerID="106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349"
Oct 31 00:40:44.882468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.882449    5925 scope.go:122] "RemoveContainer" containerID="9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"
Oct 31 00:40:44.894094 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.894069    5925 scope.go:122] "RemoveContainer" containerID="106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349"
Oct 31 00:40:44.894400 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:44.894381    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349\": container with ID starting with 106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349 not found: ID does not exist" containerID="106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349"
Oct 31 00:40:44.894592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.894454    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349"} err="failed to get container status \"106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349\": rpc error: code = NotFound desc = could not find container \"106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349\": container with ID starting with 106d596b5f67392f0643d1ce4bf97f16f6d9df4833279faf073695425e358349 not found: ID does not exist"
Oct 31 00:40:44.894592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.894480    5925 scope.go:122] "RemoveContainer" containerID="9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"
Oct 31 00:40:44.894781 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:44.894760    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc\": container with ID starting with 9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc not found: ID does not exist" containerID="9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"
Oct 31 00:40:44.894819 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:44.894792    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc"} err="failed to get container status \"9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc\": rpc error: code = NotFound desc = could not find container \"9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc\": container with ID starting with 9be58bc72da9436dd2874617223efb7c37de38b4972021db577c4985106096bc not found: ID does not exist"
Oct 31 00:40:45.029127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:45.029095    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"]
Oct 31 00:40:45.046722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:45.046691    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-49bb6b1a-openshift-default-8bcd84ddc-9tqjs"]
Oct 31 00:40:46.453971 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:46.453940    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" path="/var/lib/kubelet/pods/93e85b04-c739-4ae9-b83e-de3c61b46c55/volumes"
Oct 31 00:40:46.544481 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:40:46.544447    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:40:53.840295 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.840258    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"]
Oct 31 00:40:53.841027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841006    5925 cpu_manager.go:414] "containerMap: removing container" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy"
Oct 31 00:40:53.841027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841026    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy"
Oct 31 00:40:53.841179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841043    5925 cpu_manager.go:414] "containerMap: removing container" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy"
Oct 31 00:40:53.841179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841049    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy"
Oct 31 00:40:53.841179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841060    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy"
Oct 31 00:40:53.841179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841065    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy"
Oct 31 00:40:53.841179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841096    5925 cpu_manager.go:414] "containerMap: removing container" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy"
Oct 31 00:40:53.841179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841101    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy"
Oct 31 00:40:53.841562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841201    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy"
Oct 31 00:40:53.841562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841211    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy"
Oct 31 00:40:53.841562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841219    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy"
Oct 31 00:40:53.841562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841226    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy"
Oct 31 00:40:53.841562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.841237    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy"
Oct 31 00:40:53.846698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.846677    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.904837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.904744    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"]
Oct 31 00:40:53.905809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.905782    5925 cpu_manager.go:414] "containerMap: removing container" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy"
Oct 31 00:40:53.905809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.905806    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df75e6bd-2e2f-4e26-9c58-d6e92012d0a8" containerName="istio-proxy"
Oct 31 00:40:53.906024 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.905828    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy"
Oct 31 00:40:53.906024 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.905834    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c732995-6029-4280-a503-4afc55ad7034" containerName="istio-proxy"
Oct 31 00:40:53.906024 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.905968    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="93e85b04-c739-4ae9-b83e-de3c61b46c55" containerName="istio-proxy"
Oct 31 00:40:53.910698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.910668    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"]
Oct 31 00:40:53.910698 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.910694    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:53.923602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923568    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.923751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923657    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.923751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923719    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.924156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923893    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.924156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923932    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.924156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923965    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.924156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.923994    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw8r7\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.924156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.924053    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.924156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.924095    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:53.998896 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:53.998861    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"]
Oct 31 00:40:54.025456 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025396    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.025678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025468    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.025678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025513    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.025678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025569    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.025678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025622    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.025678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025652    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.025982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025937    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.026042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025983    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drffb\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.026042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.025986    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026021    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.026202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026137    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026177    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.026312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026238    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.026371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026326    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.026371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026357    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026515 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026394    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026515 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026462    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026619 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026523    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026619 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026567    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw8r7\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.026619 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026598    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.027092 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.026629    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.027092 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.027057    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.027463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.027399    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.029112 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.029088    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.029388 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.029368    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.085693 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.085653    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.085866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.085715    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw8r7\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7\") pod \"maas-default-gateway-openshift-default-6886b96f9-m47hc\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.127650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127574    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127626    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drffb\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127670    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127708    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127754    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127800    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127863    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.127893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127892    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.128186 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.127964    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.128186 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.128105    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.128186 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.128137    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.128297 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.128245    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.128535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.128507    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.128840 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.128819    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.130458 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.130432    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.130562 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.130541    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.161525 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.161495    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:54.186685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.186663    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.186775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.186661    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drffb\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb\") pod \"maas-default-gateway-openshift-default-6886b96f9-thjff\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.241017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.240979    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:54.600572 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.600532    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"]
Oct 31 00:40:54.604792 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:40:54.604761    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144a0bd3_b6f2_4dc8_bd95_bf6dc9bd35e9.slice/crio-e3daea4f10aa5158a5fa3a560f07dd998c2157d7b3e95cd98c944e25f9ccfcad WatchSource:0}: Error finding container e3daea4f10aa5158a5fa3a560f07dd998c2157d7b3e95cd98c944e25f9ccfcad: Status 404 returned error can't find the container with id e3daea4f10aa5158a5fa3a560f07dd998c2157d7b3e95cd98c944e25f9ccfcad
Oct 31 00:40:54.607446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.607400    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:40:54.607540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.607478    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:40:54.607540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.607505    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:40:54.661072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.661041    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"]
Oct 31 00:40:54.666998 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:40:54.666963    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358a8571_71e1_4caf_9dbc_7988c567eff6.slice/crio-aaa6244e744722d673e6007995c1314ce84f42f1e1e0dd26fb253f24ad5599cf WatchSource:0}: Error finding container aaa6244e744722d673e6007995c1314ce84f42f1e1e0dd26fb253f24ad5599cf: Status 404 returned error can't find the container with id aaa6244e744722d673e6007995c1314ce84f42f1e1e0dd26fb253f24ad5599cf
Oct 31 00:40:54.670363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.670323    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:40:54.670507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.670446    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:40:54.670507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.670491    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:40:54.961546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.961448    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" event={"ID":"358a8571-71e1-4caf-9dbc-7988c567eff6","Type":"ContainerStarted","Data":"b4b496ff372eef128bc206a63553c70aed72f13c889d967daa1112ea17d77a9c"}
Oct 31 00:40:54.962063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.962039    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" event={"ID":"358a8571-71e1-4caf-9dbc-7988c567eff6","Type":"ContainerStarted","Data":"aaa6244e744722d673e6007995c1314ce84f42f1e1e0dd26fb253f24ad5599cf"}
Oct 31 00:40:54.964204 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.964173    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" event={"ID":"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9","Type":"ContainerStarted","Data":"5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda"}
Oct 31 00:40:54.964341 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:54.964222    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" event={"ID":"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9","Type":"ContainerStarted","Data":"e3daea4f10aa5158a5fa3a560f07dd998c2157d7b3e95cd98c944e25f9ccfcad"}
Oct 31 00:40:55.162290 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.162260    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:40:55.164038 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.164005    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:40:55.164178 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.164064    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:40:55.202842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.202789    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podStartSLOduration=2.202774293 podStartE2EDuration="2.202774293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:40:55.084935015 +0000 UTC m=+1556.773814964" watchObservedRunningTime="2026-10-31 00:40:55.202774293 +0000 UTC m=+1556.891654240"
Oct 31 00:40:55.204407 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.204372    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podStartSLOduration=2.2043608199999998 podStartE2EDuration="2.20436082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:40:55.200547173 +0000 UTC m=+1556.889427120" watchObservedRunningTime="2026-10-31 00:40:55.20436082 +0000 UTC m=+1556.893240839"
Oct 31 00:40:55.241842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.241755    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:40:55.243079 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.243052    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:40:55.243208 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:55.243099    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:40:56.163440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:56.162513    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:40:56.163440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:56.162581    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:40:56.247440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:56.243749    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:40:56.247440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:56.243806    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:40:57.163439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:57.162242    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:40:57.163439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:57.162298    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:40:57.247440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:57.243813    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:40:57.247440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:57.243885    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:40:58.162834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:58.162795    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:40:58.163118 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:58.163086    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:40:58.260367 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:58.259959    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:40:58.260367 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:58.260019    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:40:59.163440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:59.162952    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:40:59.163440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:59.163035    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:40:59.243866 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:59.243772    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:40:59.244133 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:40:59.244103    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:41:00.174438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:00.173775    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:41:00.174438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:00.173837    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:41:00.245440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:00.244053    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:41:00.249435 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:00.244129    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:41:01.161923 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:01.161877    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:41:01.162142 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:01.161950    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:41:01.241939 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:01.241899    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:41:01.242714 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:01.241973    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:41:02.162560 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:02.162520    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-m47hc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 31 00:41:02.162788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:02.162596    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 31 00:41:02.242517 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:02.242475    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 31 00:41:02.242996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:02.242543    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 31 00:41:03.672026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:03.671994    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:41:03.674210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:03.674180    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:41:03.675598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:03.675578    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:41:04.049068 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:04.048985    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:41:04.049842 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:04.049807    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:41:04.051517 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:04.051493    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 00:41:14.138329 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.138294    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"]
Oct 31 00:41:14.143179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.143142    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.198177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.198146    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"]
Oct 31 00:41:14.233983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.233940    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.234123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.234019    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.234281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.234255    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.234442 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.234399    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52hgz\" (UniqueName: \"kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.241342 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.241314    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dd862feb-serving-cert\""
Oct 31 00:41:14.336125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.336092    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52hgz\" (UniqueName: \"kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.336281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.336190    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.336281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.336222    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.336364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.336327    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.336433 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:14.336397    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-serving-cert: secret "maas-api-e2e-ait-dd862feb-serving-cert" not found
Oct 31 00:41:14.336505 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:14.336492    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls podName:1ffada0a-505d-4836-948f-0517674cc25b nodeName:}" failed. No retries permitted until 2026-10-31 00:41:14.836470208 +0000 UTC m=+1576.525350135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls") pod "maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" (UID: "1ffada0a-505d-4836-948f-0517674cc25b") : secret "maas-api-e2e-ait-dd862feb-serving-cert" not found
Oct 31 00:41:14.337021 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.337002    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.338717 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.338697    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.399404 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.399307    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52hgz\" (UniqueName: \"kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.846435 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.846385    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:14.849039 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:14.849012    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\") pod \"maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:15.058941 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:15.058907    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:15.447998 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:15.447926    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"]
Oct 31 00:41:15.452528 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:41:15.452493    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffada0a_505d_4836_948f_0517674cc25b.slice/crio-4d5f360a2b9ee2458227b673884c639539432a0103f65cf4a8cd52e2791cc2db WatchSource:0}: Error finding container 4d5f360a2b9ee2458227b673884c639539432a0103f65cf4a8cd52e2791cc2db: Status 404 returned error can't find the container with id 4d5f360a2b9ee2458227b673884c639539432a0103f65cf4a8cd52e2791cc2db
Oct 31 00:41:16.221330 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:16.221298    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" event={"ID":"1ffada0a-505d-4836-948f-0517674cc25b","Type":"ContainerStarted","Data":"4d5f360a2b9ee2458227b673884c639539432a0103f65cf4a8cd52e2791cc2db"}
Oct 31 00:41:16.543028 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:16.542927    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:41:17.231207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:17.231169    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" event={"ID":"1ffada0a-505d-4836-948f-0517674cc25b","Type":"ContainerStarted","Data":"8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c"}
Oct 31 00:41:17.231406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:17.231261    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:17.348564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:17.348512    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" podStartSLOduration=2.49005273 podStartE2EDuration="3.348499424s" totalImagesPullingTime="858.446694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:17.343798855 +0000 UTC m=+1579.032678801" watchObservedRunningTime="2026-10-31 00:41:17.348499424 +0000 UTC m=+1579.037379369"
Oct 31 00:41:23.244544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:23.244513    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:41:24.773836 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.773796    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"]
Oct 31 00:41:24.778564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.778540    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:24.833374 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.833342    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"]
Oct 31 00:41:24.882266 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.880593    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-74c6ba99-serving-cert\""
Oct 31 00:41:24.917222 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.917188    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:24.917731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.917708    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:24.917896 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.917802    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lllt\" (UniqueName: \"kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:24.917971 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:24.917948    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.019343 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.019307    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.019516 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.019380    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lllt\" (UniqueName: \"kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.019516 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.019505    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.019598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.019563    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.019736 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:25.019715    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-serving-cert: secret "maas-api-e2e-derive-74c6ba99-serving-cert" not found
Oct 31 00:41:25.019812 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:25.019790    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls podName:d9b326f7-dd63-474a-a2a3-40df1f544fe0 nodeName:}" failed. No retries permitted until 2026-10-31 00:41:25.519768493 +0000 UTC m=+1587.208648420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls") pod "maas-api-e2e-derive-74c6ba99-844f469-992tt" (UID: "d9b326f7-dd63-474a-a2a3-40df1f544fe0") : secret "maas-api-e2e-derive-74c6ba99-serving-cert" not found
Oct 31 00:41:25.020160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.020141    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.021800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.021779    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.090169 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.090135    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lllt\" (UniqueName: \"kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.530634 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.530536    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.533053 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.533021    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\") pod \"maas-api-e2e-derive-74c6ba99-844f469-992tt\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:25.694646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:25.694616    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:26.089437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:26.088913    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"]
Oct 31 00:41:26.096379 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:41:26.096348    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b326f7_dd63_474a_a2a3_40df1f544fe0.slice/crio-4fbe985238f7ae0bc615cf67bf6f66c896542e22cbe511e72231459922a490d1 WatchSource:0}: Error finding container 4fbe985238f7ae0bc615cf67bf6f66c896542e22cbe511e72231459922a490d1: Status 404 returned error can't find the container with id 4fbe985238f7ae0bc615cf67bf6f66c896542e22cbe511e72231459922a490d1
Oct 31 00:41:26.308409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:26.308376    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt" event={"ID":"d9b326f7-dd63-474a-a2a3-40df1f544fe0","Type":"ContainerStarted","Data":"4fbe985238f7ae0bc615cf67bf6f66c896542e22cbe511e72231459922a490d1"}
Oct 31 00:41:27.333685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:27.333648    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt" event={"ID":"d9b326f7-dd63-474a-a2a3-40df1f544fe0","Type":"ContainerStarted","Data":"eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d"}
Oct 31 00:41:27.334222 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:27.334203    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:27.503074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:27.502974    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt" podStartSLOduration=2.516066652 podStartE2EDuration="3.502960235s" totalImagesPullingTime="986.893583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:27.502589578 +0000 UTC m=+1589.191469526" watchObservedRunningTime="2026-10-31 00:41:27.502960235 +0000 UTC m=+1589.191840179"
Oct 31 00:41:29.604937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:29.604904    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"]
Oct 31 00:41:29.605394 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:29.605143    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" containerID="cri-o://b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d" gracePeriod=30
Oct 31 00:41:33.349397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:33.349366    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:41:34.752000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:34.751961    5925 patch_prober.go:29] interesting pod/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 31 00:41:34.752467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:34.752429    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 31 00:41:34.944519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:34.944488    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:41:35.037875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.037844    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.037875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.037883    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038103 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.037903    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038103 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.037939    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038103 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.037975    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038103 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038078    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038104    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038160    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038163    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:35.038317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038258    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy\") pod \"0716c17a-decd-45d1-9208-724f02257880\" (UID: \"0716c17a-decd-45d1-9208-724f02257880\") "
Oct 31 00:41:35.038568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038332    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:41:35.038568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038369    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:35.038666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038626    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:35.038815 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.038793    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:35.039140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.039116    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.039238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.039143    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0716c17a-decd-45d1-9208-724f02257880-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.039238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.039160    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.039238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.039173    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.039238 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.039188    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.040755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.040713    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:41:35.040875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.040761    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:35.040875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.040837    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "kube-api-access-9g8sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:41:35.041127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.041104    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo" pod "0716c17a-decd-45d1-9208-724f02257880" (UID: "0716c17a-decd-45d1-9208-724f02257880"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:41:35.140533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.140501    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g8sd\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-kube-api-access-9g8sd\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.140533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.140530    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0716c17a-decd-45d1-9208-724f02257880-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.140533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.140539    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0716c17a-decd-45d1-9208-724f02257880-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.140770 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.140548    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0716c17a-decd-45d1-9208-724f02257880-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:35.422742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.422694    5925 generic.go:356] "Generic (PLEG): container finished" podID="0716c17a-decd-45d1-9208-724f02257880" containerID="b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d" exitCode=0
Oct 31 00:41:35.422742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.422738    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"
Oct 31 00:41:35.423034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.422755    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" event={"ID":"0716c17a-decd-45d1-9208-724f02257880","Type":"ContainerDied","Data":"b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d"}
Oct 31 00:41:35.423034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.422847    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6" event={"ID":"0716c17a-decd-45d1-9208-724f02257880","Type":"ContainerDied","Data":"b023b53549756b3758be5a9e67da531c04a58fbf45a83ddb3d44aa018c6b016c"}
Oct 31 00:41:35.423034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.422880    5925 scope.go:122] "RemoveContainer" containerID="b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d"
Oct 31 00:41:35.434896 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.434872    5925 scope.go:122] "RemoveContainer" containerID="b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d"
Oct 31 00:41:35.435189 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:35.435168    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d\": container with ID starting with b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d not found: ID does not exist" containerID="b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d"
Oct 31 00:41:35.435261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.435203    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d"} err="failed to get container status \"b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d\": rpc error: code = NotFound desc = could not find container \"b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d\": container with ID starting with b54f7a8590ca289d2f2086dee695ffbbeacbc219d386eaf9099949d73014488d not found: ID does not exist"
Oct 31 00:41:35.583896 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.583865    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"]
Oct 31 00:41:35.631364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:35.631333    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-z5rd6"]
Oct 31 00:41:36.457129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:36.457092    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0716c17a-decd-45d1-9208-724f02257880" path="/var/lib/kubelet/pods/0716c17a-decd-45d1-9208-724f02257880/volumes"
Oct 31 00:41:45.199991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:45.199950    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"]
Oct 31 00:41:45.200490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:45.200195    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy" containerID="cri-o://49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64" gracePeriod=30
Oct 31 00:41:46.550221 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:46.550173    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:41:50.507894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.507866    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:41:50.616515 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616487    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.616712 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616562    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.616712 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616597    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.616712 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616683    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.616876 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616767    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.616876 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616854    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.616974 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616853    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:50.616974 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616926    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:50.617080 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616938    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:50.617080 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616987    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.617080 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.616999    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:50.617080 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617019    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.617080 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617045    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy\") pod \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\" (UID: \"ef63974a-5d38-41cb-ab97-18acbbdb8a1a\") "
Oct 31 00:41:50.617315 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617147    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:41:50.617549 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617532    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.617636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617555    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.617636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617568    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.617636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617580    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.617636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.617593    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.619090 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.619062    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:41:50.619251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.619232    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:41:50.619310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.619248    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "kube-api-access-zcjm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:41:50.619310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.619232    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token" pod "ef63974a-5d38-41cb-ab97-18acbbdb8a1a" (UID: "ef63974a-5d38-41cb-ab97-18acbbdb8a1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:41:50.719285 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.719187    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.719285 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.719225    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.719285 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.719239    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.719285 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.719253    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcjm6\" (UniqueName: \"kubernetes.io/projected/ef63974a-5d38-41cb-ab97-18acbbdb8a1a-kube-api-access-zcjm6\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:41:50.762673 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.762637    5925 generic.go:356] "Generic (PLEG): container finished" podID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerID="49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64" exitCode=0
Oct 31 00:41:50.762830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.762698    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"
Oct 31 00:41:50.762830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.762724    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" event={"ID":"ef63974a-5d38-41cb-ab97-18acbbdb8a1a","Type":"ContainerDied","Data":"49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64"}
Oct 31 00:41:50.762830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.762802    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj" event={"ID":"ef63974a-5d38-41cb-ab97-18acbbdb8a1a","Type":"ContainerDied","Data":"270d9c2a09a299402e99f622c998c8cd2f8efa3018b7b3e0e42934f19543d704"}
Oct 31 00:41:50.762940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.762838    5925 scope.go:122] "RemoveContainer" containerID="49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64"
Oct 31 00:41:50.777000 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.776974    5925 scope.go:122] "RemoveContainer" containerID="49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64"
Oct 31 00:41:50.777328 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:41:50.777304    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64\": container with ID starting with 49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64 not found: ID does not exist" containerID="49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64"
Oct 31 00:41:50.777378 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.777341    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64"} err="failed to get container status \"49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64\": rpc error: code = NotFound desc = could not find container \"49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64\": container with ID starting with 49be89dc58fe2b70a07dfb5506aec1e408f88557686d7d985a7bd38f05a7ba64 not found: ID does not exist"
Oct 31 00:41:50.926256 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.926226    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"]
Oct 31 00:41:50.935545 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:50.935520    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-5wzlj"]
Oct 31 00:41:52.454237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:41:52.454199    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" path="/var/lib/kubelet/pods/ef63974a-5d38-41cb-ab97-18acbbdb8a1a/volumes"
Oct 31 00:42:16.545359 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:42:16.545272    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:42:17.010037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.009998    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"]
Oct 31 00:42:17.010767 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.010745    5925 cpu_manager.go:414] "containerMap: removing container" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy"
Oct 31 00:42:17.010767 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.010765    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy"
Oct 31 00:42:17.010951 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.010792    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy"
Oct 31 00:42:17.010951 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.010800    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy"
Oct 31 00:42:17.011048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.011013    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="0716c17a-decd-45d1-9208-724f02257880" containerName="istio-proxy"
Oct 31 00:42:17.011048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.011031    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef63974a-5d38-41cb-ab97-18acbbdb8a1a" containerName="istio-proxy"
Oct 31 00:42:17.014645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.014626    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.064985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.064946    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w4-4b86e4-serving-cert\""
Oct 31 00:42:17.086079 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.086046    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.086220 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.086160    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.086220 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.086203    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbx7x\" (UniqueName: \"kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.086337 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.086250    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.116213 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.116182    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"]
Oct 31 00:42:17.187252 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.187219    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.187462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.187296    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.187462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.187328    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbx7x\" (UniqueName: \"kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.187462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.187369    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.187462 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:42:17.187388    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-serving-cert: secret "maas-api-e2e-shared-a-w4-4b86e4-serving-cert" not found
Oct 31 00:42:17.187708 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:42:17.187485    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls podName:493eb066-3aa0-421a-b24f-a837a3e73add nodeName:}" failed. No retries permitted until 2026-10-31 00:42:17.687464263 +0000 UTC m=+1639.376344190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls") pod "maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" (UID: "493eb066-3aa0-421a-b24f-a837a3e73add") : secret "maas-api-e2e-shared-a-w4-4b86e4-serving-cert" not found
Oct 31 00:42:17.188257 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.188226    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.189808 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.189788    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.256366 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.256334    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbx7x\" (UniqueName: \"kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.696776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.696743    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.699215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.699188    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:17.930594 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:17.930548    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:18.316659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:18.316569    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"]
Oct 31 00:42:18.321628 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:42:18.321600    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493eb066_3aa0_421a_b24f_a837a3e73add.slice/crio-aaa2b66f0f1c9f06d0925e7b5b68c7b5e3bf14187b533e2747a906b8495a9ae1 WatchSource:0}: Error finding container aaa2b66f0f1c9f06d0925e7b5b68c7b5e3bf14187b533e2747a906b8495a9ae1: Status 404 returned error can't find the container with id aaa2b66f0f1c9f06d0925e7b5b68c7b5e3bf14187b533e2747a906b8495a9ae1
Oct 31 00:42:19.021964 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:19.021924    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" event={"ID":"493eb066-3aa0-421a-b24f-a837a3e73add","Type":"ContainerStarted","Data":"aaa2b66f0f1c9f06d0925e7b5b68c7b5e3bf14187b533e2747a906b8495a9ae1"}
Oct 31 00:42:20.030001 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:20.029964    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" event={"ID":"493eb066-3aa0-421a-b24f-a837a3e73add","Type":"ContainerStarted","Data":"70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8"}
Oct 31 00:42:20.030468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:20.030061    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:20.148437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:20.147641    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" podStartSLOduration=3.234401189 podStartE2EDuration="4.147622964s" totalImagesPullingTime="913.221775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:20.143778967 +0000 UTC m=+1641.832658915" watchObservedRunningTime="2026-10-31 00:42:20.147622964 +0000 UTC m=+1641.836502908"
Oct 31 00:42:26.042835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:26.042806    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 00:42:27.730249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.730217    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"]
Oct 31 00:42:27.734931 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.734910    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.786082 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.786051    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f0651cac-serving-cert\""
Oct 31 00:42:27.792455 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.792430    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"]
Oct 31 00:42:27.853491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.853457    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.853679 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.853565    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.853736 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.853705    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.853797 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.853781    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.955589 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.955555    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.955760 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.955681    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.955760 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:42:27.955711    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-serving-cert: secret "maas-api-e2e-mt-f0651cac-serving-cert" not found
Oct 31 00:42:27.955834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.955714    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.955834 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:42:27.955779    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls podName:7109fc2a-8c0c-4032-9ad0-f0199cac1d0d nodeName:}" failed. No retries permitted until 2026-10-31 00:42:28.455757678 +0000 UTC m=+1650.144637605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls") pod "maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" (UID: "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d") : secret "maas-api-e2e-mt-f0651cac-serving-cert" not found
Oct 31 00:42:27.955919 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.955901    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.956258 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.956242    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:27.958228 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:27.958208    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:28.020321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:28.020248    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:28.489457 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:28.488125    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:28.506009 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:28.505972    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\") pod \"maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:28.648720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:28.648690    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:29.044079 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:29.044020    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"]
Oct 31 00:42:29.049277 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:42:29.049185    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7109fc2a_8c0c_4032_9ad0_f0199cac1d0d.slice/crio-2170c2170d78234088d1507e7669276a482332144d73c0b53803349b9b24eabd WatchSource:0}: Error finding container 2170c2170d78234088d1507e7669276a482332144d73c0b53803349b9b24eabd: Status 404 returned error can't find the container with id 2170c2170d78234088d1507e7669276a482332144d73c0b53803349b9b24eabd
Oct 31 00:42:29.117814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:29.117775    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" event={"ID":"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d","Type":"ContainerStarted","Data":"2170c2170d78234088d1507e7669276a482332144d73c0b53803349b9b24eabd"}
Oct 31 00:42:30.131982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:30.131946    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" event={"ID":"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d","Type":"ContainerStarted","Data":"79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485"}
Oct 31 00:42:30.132384 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:30.132005    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:30.258478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:30.258343    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" podStartSLOduration=2.36172422 podStartE2EDuration="3.258328575s" totalImagesPullingTime="896.604355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:30.257772531 +0000 UTC m=+1651.946652477" watchObservedRunningTime="2026-10-31 00:42:30.258328575 +0000 UTC m=+1651.947208519"
Oct 31 00:42:34.463959 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.463929    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"]
Oct 31 00:42:34.470197 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.470170    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.521364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.521334    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-74c6ba99-openshift-default-dockercfg-mnr9m\""
Oct 31 00:42:34.581163 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.581122    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"]
Oct 31 00:42:34.623681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.623632    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.623840 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.623693    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.623840 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.623759    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.623914 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.623847    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.623992 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.623973    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.624176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.624161    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.624431 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.624402    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.624540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.624529    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.624664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.624645    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcpss\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.725624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725499    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.725624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725555    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.725865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725641    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.725865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725671    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.725865 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725756    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcpss\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725862    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725917    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.725965    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.726014    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726034 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.726018    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.726043    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.726293    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.726731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.726706    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.727174 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.727150    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.729486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.729289    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.732458 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.729642    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.784816 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.784785    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcpss\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.784964 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.784790    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token\") pod \"e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") " pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:34.821205 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:34.821176    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:35.262237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:35.262195    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"]
Oct 31 00:42:35.267293 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:42:35.267264    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ed26e6_5654_4104_b965_d8990a2afd53.slice/crio-b3a400572a1263034430542bf463a8682e2a9f795cbeb9fd5805e783d25391b1 WatchSource:0}: Error finding container b3a400572a1263034430542bf463a8682e2a9f795cbeb9fd5805e783d25391b1: Status 404 returned error can't find the container with id b3a400572a1263034430542bf463a8682e2a9f795cbeb9fd5805e783d25391b1
Oct 31 00:42:35.269835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:35.269806    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:42:35.269897 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:35.269869    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:42:35.269938 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:35.269904    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:42:35.282490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:35.282459    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" event={"ID":"18ed26e6-5654-4104-b965-d8990a2afd53","Type":"ContainerStarted","Data":"b3a400572a1263034430542bf463a8682e2a9f795cbeb9fd5805e783d25391b1"}
Oct 31 00:42:36.169095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:36.169066    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:42:36.292241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:36.292200    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" event={"ID":"18ed26e6-5654-4104-b965-d8990a2afd53","Type":"ContainerStarted","Data":"0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57"}
Oct 31 00:42:36.469555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:36.469370    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podStartSLOduration=2.46935141 podStartE2EDuration="2.46935141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:36.468998676 +0000 UTC m=+1658.157878622" watchObservedRunningTime="2026-10-31 00:42:36.46935141 +0000 UTC m=+1658.158231355"
Oct 31 00:42:36.821749 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:36.821661    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:36.823638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:36.823608    5925 patch_prober.go:29] interesting pod/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 00:42:36.823778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:36.823655    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 00:42:37.822391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:37.822352    5925 patch_prober.go:29] interesting pod/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 00:42:37.822875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:37.822430    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 00:42:38.822019 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:38.821977    5925 patch_prober.go:29] interesting pod/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 00:42:38.822176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:38.822036    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 00:42:39.822317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:39.822284    5925 patch_prober.go:29] interesting pod/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 00:42:39.822737 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:39.822339    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 00:42:40.821598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:40.821564    5925 patch_prober.go:29] interesting pod/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 00:42:40.821771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:40.821616    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 00:42:41.826539 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:41.826508    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:41.827012 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:41.826884    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:41.827620 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:42:41.827602    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:42:46.543365 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:42:46.543323    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:43:10.575941 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:10.575908    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"]
Oct 31 00:43:10.576570 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:10.576124    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" podUID="1ffada0a-505d-4836-948f-0517674cc25b" containerName="maas-api" containerID="cri-o://8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c" gracePeriod=30
Oct 31 00:43:10.937358 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:10.937323    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:43:11.045635 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.045594    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\") pod \"1ffada0a-505d-4836-948f-0517674cc25b\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") "
Oct 31 00:43:11.045830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.045724    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs\") pod \"1ffada0a-505d-4836-948f-0517674cc25b\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") "
Oct 31 00:43:11.045830 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.045806    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca\") pod \"1ffada0a-505d-4836-948f-0517674cc25b\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") "
Oct 31 00:43:11.046003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.045986    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz\" (UniqueName: \"kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz\") pod \"1ffada0a-505d-4836-948f-0517674cc25b\" (UID: \"1ffada0a-505d-4836-948f-0517674cc25b\") "
Oct 31 00:43:11.047249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.047192    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca" pod "1ffada0a-505d-4836-948f-0517674cc25b" (UID: "1ffada0a-505d-4836-948f-0517674cc25b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:43:11.055551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.055505    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz" pod "1ffada0a-505d-4836-948f-0517674cc25b" (UID: "1ffada0a-505d-4836-948f-0517674cc25b"). InnerVolumeSpecName "kube-api-access-52hgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:11.067789 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.061183    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs" pod "1ffada0a-505d-4836-948f-0517674cc25b" (UID: "1ffada0a-505d-4836-948f-0517674cc25b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:43:11.067789 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.064829    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls" pod "1ffada0a-505d-4836-948f-0517674cc25b" (UID: "1ffada0a-505d-4836-948f-0517674cc25b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:43:11.148907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.148874    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:11.148907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.148907    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ffada0a-505d-4836-948f-0517674cc25b-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:11.149111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.148923    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ffada0a-505d-4836-948f-0517674cc25b-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:11.149111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.148939    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52hgz\" (UniqueName: \"kubernetes.io/projected/1ffada0a-505d-4836-948f-0517674cc25b-kube-api-access-52hgz\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:11.706616 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.706578    5925 generic.go:356] "Generic (PLEG): container finished" podID="1ffada0a-505d-4836-948f-0517674cc25b" containerID="8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c" exitCode=0
Oct 31 00:43:11.707435 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.707391    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" event={"ID":"1ffada0a-505d-4836-948f-0517674cc25b","Type":"ContainerDied","Data":"8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c"}
Oct 31 00:43:11.707630 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.707610    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x" event={"ID":"1ffada0a-505d-4836-948f-0517674cc25b","Type":"ContainerDied","Data":"4d5f360a2b9ee2458227b673884c639539432a0103f65cf4a8cd52e2791cc2db"}
Oct 31 00:43:11.707753 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.707739    5925 scope.go:122] "RemoveContainer" containerID="8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c"
Oct 31 00:43:11.708018 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.708001    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"
Oct 31 00:43:11.724780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.724756    5925 scope.go:122] "RemoveContainer" containerID="8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c"
Oct 31 00:43:11.725094 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:11.725071    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c\": container with ID starting with 8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c not found: ID does not exist" containerID="8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c"
Oct 31 00:43:11.725195 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.725106    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c"} err="failed to get container status \"8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c\": rpc error: code = NotFound desc = could not find container \"8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c\": container with ID starting with 8e22ef1d989fc83f9f5accd530a7f69e77532abfa6156f508f9ab34428542d2c not found: ID does not exist"
Oct 31 00:43:11.869334 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.869300    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"]
Oct 31 00:43:11.916216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:11.916178    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dd862feb-7948cdc944-4lx5x"]
Oct 31 00:43:12.453308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:12.453275    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ffada0a-505d-4836-948f-0517674cc25b" path="/var/lib/kubelet/pods/1ffada0a-505d-4836-948f-0517674cc25b/volumes"
Oct 31 00:43:14.507862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:14.507817    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"]
Oct 31 00:43:14.508319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:14.508023    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy" containerID="cri-o://362abc5056e0fb5c9c8eb81c3abb0a234611d2f15157b49eb01211d247c72eb9" gracePeriod=30
Oct 31 00:43:14.554821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:14.554786    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"]
Oct 31 00:43:14.555022 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:14.554999    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy" containerID="cri-o://83bacd84d3dd0620c7615c787e910309712a51a297e3bc577c610951755bd590" gracePeriod=30
Oct 31 00:43:15.548096 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:15.548064    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"]
Oct 31 00:43:15.548542 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:15.548296    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy" containerID="cri-o://e843be3deabc6febe68b9521d112df97ad2d0c892cae0fbd70c2c5f2a02b1595" gracePeriod=30
Oct 31 00:43:16.626644 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:16.626604    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:43:19.773514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.773406    5925 generic.go:356] "Generic (PLEG): container finished" podID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerID="362abc5056e0fb5c9c8eb81c3abb0a234611d2f15157b49eb01211d247c72eb9" exitCode=0
Oct 31 00:43:19.773514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.773462    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" event={"ID":"083fe01c-e7f8-43e5-9c89-d4537eac88a5","Type":"ContainerDied","Data":"362abc5056e0fb5c9c8eb81c3abb0a234611d2f15157b49eb01211d247c72eb9"}
Oct 31 00:43:19.775580 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.775553    5925 generic.go:356] "Generic (PLEG): container finished" podID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerID="83bacd84d3dd0620c7615c787e910309712a51a297e3bc577c610951755bd590" exitCode=0
Oct 31 00:43:19.775706 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.775592    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" event={"ID":"52deace2-9bc5-489f-86bb-063c9dfc8408","Type":"ContainerDied","Data":"83bacd84d3dd0620c7615c787e910309712a51a297e3bc577c610951755bd590"}
Oct 31 00:43:19.837581 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.837550    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:43:19.872864 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.872840    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:43:19.899814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.899782    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.899932    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.899984    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900022    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900060    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900090    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:19.900279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900173    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900251    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900447 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900340    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900447 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900382    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo\") pod \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\" (UID: \"083fe01c-e7f8-43e5-9c89-d4537eac88a5\") "
Oct 31 00:43:19.900591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900559    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900703    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.900912    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.901161    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.901185    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.901200    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.901213    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:19.901236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.901231    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:43:19.902783 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.902760    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "kube-api-access-7qtch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:19.903027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.903008    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:43:19.903167 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.903145    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:19.903167 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:19.903153    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy" pod "083fe01c-e7f8-43e5-9c89-d4537eac88a5" (UID: "083fe01c-e7f8-43e5-9c89-d4537eac88a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.001911 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.001876    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.001932    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.001968    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002056    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002088    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002118    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002145    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002174    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002273    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket\") pod \"52deace2-9bc5-489f-86bb-063c9dfc8408\" (UID: \"52deace2-9bc5-489f-86bb-063c9dfc8408\") "
Oct 31 00:43:20.002576 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002305    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:43:20.002576 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002388    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.002685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002592    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.002685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002637    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.002800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002312    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.002945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002928    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002951    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qtch\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-kube-api-access-7qtch\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002968    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002983    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.002997    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.003012    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52deace2-9bc5-489f-86bb-063c9dfc8408-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.003026    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.003040    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.003054    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.003162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.003067    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/083fe01c-e7f8-43e5-9c89-d4537eac88a5-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.004601 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.004578    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:43:20.004678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.004614    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:20.004859 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.004831    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "kube-api-access-22hmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:20.004949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.004857    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy" pod "52deace2-9bc5-489f-86bb-063c9dfc8408" (UID: "52deace2-9bc5-489f-86bb-063c9dfc8408"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.104666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.104634    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22hmc\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-kube-api-access-22hmc\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.104666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.104664    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.104666 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.104683    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.104921 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.104693    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52deace2-9bc5-489f-86bb-063c9dfc8408-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.785935 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.785903    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"
Oct 31 00:43:20.786429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.785907    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28" event={"ID":"52deace2-9bc5-489f-86bb-063c9dfc8408","Type":"ContainerDied","Data":"fcbf6ac354f2af7ee5d5e4cac91bccdd34a02f1116657d01730070e0272864ef"}
Oct 31 00:43:20.786429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.786078    5925 scope.go:122] "RemoveContainer" containerID="83bacd84d3dd0620c7615c787e910309712a51a297e3bc577c610951755bd590"
Oct 31 00:43:20.787875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.787854    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"
Oct 31 00:43:20.788325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.788275    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb" event={"ID":"083fe01c-e7f8-43e5-9c89-d4537eac88a5","Type":"ContainerDied","Data":"e1ba8052995e7b70ef07693a9d0b8c4cd185f7721a28ff850f1f20389c29c67b"}
Oct 31 00:43:20.791207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.790296    5925 generic.go:356] "Generic (PLEG): container finished" podID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerID="e843be3deabc6febe68b9521d112df97ad2d0c892cae0fbd70c2c5f2a02b1595" exitCode=0
Oct 31 00:43:20.791207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.790326    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" event={"ID":"50d28b4f-7a5f-461f-a678-2f892711f2b1","Type":"ContainerDied","Data":"e843be3deabc6febe68b9521d112df97ad2d0c892cae0fbd70c2c5f2a02b1595"}
Oct 31 00:43:20.803874 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.803854    5925 scope.go:122] "RemoveContainer" containerID="362abc5056e0fb5c9c8eb81c3abb0a234611d2f15157b49eb01211d247c72eb9"
Oct 31 00:43:20.837168 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.837145    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:43:20.915778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.915744    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.915972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.915819    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.915972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.915870    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.915972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.915909    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.916128 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.915972    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.916128 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916003    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.916128 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916005    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.916128 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916075    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.916298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916159    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.916298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916209    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.916298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916216    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.916298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916258    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert\") pod \"50d28b4f-7a5f-461f-a678-2f892711f2b1\" (UID: \"50d28b4f-7a5f-461f-a678-2f892711f2b1\") "
Oct 31 00:43:20.916298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916280    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.916680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916646    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:43:20.916894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916874    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50d28b4f-7a5f-461f-a678-2f892711f2b1-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.916894 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916894    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.917045 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916903    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.917045 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916912    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.917045 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.916922    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:20.918243 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.918216    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:20.918356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.918306    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:43:20.918661 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.918640    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:20.918746 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.918662    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr" pod "50d28b4f-7a5f-461f-a678-2f892711f2b1" (UID: "50d28b4f-7a5f-461f-a678-2f892711f2b1"). InnerVolumeSpecName "kube-api-access-92pnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:20.992635 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:20.992552    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"]
Oct 31 00:43:21.018397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.018360    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:21.018397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.018389    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:21.018397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.018400    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:21.018397 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.018409    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92pnr\" (UniqueName: \"kubernetes.io/projected/50d28b4f-7a5f-461f-a678-2f892711f2b1-kube-api-access-92pnr\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:21.040387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.040355    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-rgq28"]
Oct 31 00:43:21.220968 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.220891    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"]
Oct 31 00:43:21.225062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.225022    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-97rfb"]
Oct 31 00:43:21.802585 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.802553    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"
Oct 31 00:43:21.803095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.802586    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl" event={"ID":"50d28b4f-7a5f-461f-a678-2f892711f2b1","Type":"ContainerDied","Data":"14e91e04a9f16a56a0ffe794a64065a4494be3a96bc99adb48f1c057e7852f99"}
Oct 31 00:43:21.803095 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.802662    5925 scope.go:122] "RemoveContainer" containerID="e843be3deabc6febe68b9521d112df97ad2d0c892cae0fbd70c2c5f2a02b1595"
Oct 31 00:43:21.963035 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:21.963004    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"]
Oct 31 00:43:22.010429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.010382    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-tskrl"]
Oct 31 00:43:22.353441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.350025    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"]
Oct 31 00:43:22.353441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.350226    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt" podUID="d9b326f7-dd63-474a-a2a3-40df1f544fe0" containerName="maas-api" containerID="cri-o://eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d" gracePeriod=30
Oct 31 00:43:22.484484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.473839    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" path="/var/lib/kubelet/pods/083fe01c-e7f8-43e5-9c89-d4537eac88a5/volumes"
Oct 31 00:43:22.484484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.474594    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" path="/var/lib/kubelet/pods/50d28b4f-7a5f-461f-a678-2f892711f2b1/volumes"
Oct 31 00:43:22.484484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.475579    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" path="/var/lib/kubelet/pods/52deace2-9bc5-489f-86bb-063c9dfc8408/volumes"
Oct 31 00:43:22.770323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.770297    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:43:22.814028 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.813994    5925 generic.go:356] "Generic (PLEG): container finished" podID="d9b326f7-dd63-474a-a2a3-40df1f544fe0" containerID="eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d" exitCode=0
Oct 31 00:43:22.814563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.814060    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt" event={"ID":"d9b326f7-dd63-474a-a2a3-40df1f544fe0","Type":"ContainerDied","Data":"eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d"}
Oct 31 00:43:22.814563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.814064    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"
Oct 31 00:43:22.814563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.814145    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt" event={"ID":"d9b326f7-dd63-474a-a2a3-40df1f544fe0","Type":"ContainerDied","Data":"4fbe985238f7ae0bc615cf67bf6f66c896542e22cbe511e72231459922a490d1"}
Oct 31 00:43:22.814563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.814180    5925 scope.go:122] "RemoveContainer" containerID="eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d"
Oct 31 00:43:22.825312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.825283    5925 scope.go:122] "RemoveContainer" containerID="eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d"
Oct 31 00:43:22.825639 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:22.825614    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d\": container with ID starting with eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d not found: ID does not exist" containerID="eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d"
Oct 31 00:43:22.825757 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.825648    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d"} err="failed to get container status \"eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d\": rpc error: code = NotFound desc = could not find container \"eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d\": container with ID starting with eb541303ee205dbd86846c387aab169697ac0d784be2a999f3a0ca49decdc50d not found: ID does not exist"
Oct 31 00:43:22.865649 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.865610    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\") pod \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") "
Oct 31 00:43:22.865852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.865690    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca\") pod \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") "
Oct 31 00:43:22.865852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.865786    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs\") pod \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") "
Oct 31 00:43:22.866007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.865982    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt\" (UniqueName: \"kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt\") pod \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\" (UID: \"d9b326f7-dd63-474a-a2a3-40df1f544fe0\") "
Oct 31 00:43:22.866158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.866101    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca" pod "d9b326f7-dd63-474a-a2a3-40df1f544fe0" (UID: "d9b326f7-dd63-474a-a2a3-40df1f544fe0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:43:22.866568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.866547    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9b326f7-dd63-474a-a2a3-40df1f544fe0-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:22.868003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.867979    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs" pod "d9b326f7-dd63-474a-a2a3-40df1f544fe0" (UID: "d9b326f7-dd63-474a-a2a3-40df1f544fe0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:43:22.868100 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.868031    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls" pod "d9b326f7-dd63-474a-a2a3-40df1f544fe0" (UID: "d9b326f7-dd63-474a-a2a3-40df1f544fe0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:43:22.868327 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.868307    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt" pod "d9b326f7-dd63-474a-a2a3-40df1f544fe0" (UID: "d9b326f7-dd63-474a-a2a3-40df1f544fe0"). InnerVolumeSpecName "kube-api-access-2lllt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:22.968182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.968088    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:22.968182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.968122    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lllt\" (UniqueName: \"kubernetes.io/projected/d9b326f7-dd63-474a-a2a3-40df1f544fe0-kube-api-access-2lllt\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:22.968182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:22.968137    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9b326f7-dd63-474a-a2a3-40df1f544fe0-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:23.232911 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:23.232801    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"]
Oct 31 00:43:23.237470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:23.237440    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74c6ba99-844f469-992tt"]
Oct 31 00:43:24.454148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:24.454113    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9b326f7-dd63-474a-a2a3-40df1f544fe0" path="/var/lib/kubelet/pods/d9b326f7-dd63-474a-a2a3-40df1f544fe0/volumes"
Oct 31 00:43:25.043401 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:25.043361    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"]
Oct 31 00:43:25.043668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:25.043638    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" containerID="cri-o://0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57" gracePeriod=30
Oct 31 00:43:26.829668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:26.829623    5925 patch_prober.go:29] interesting pod/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:43:26.830065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:26.829716    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:43:29.046326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.046288    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"]
Oct 31 00:43:29.046989 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.046971    5925 cpu_manager.go:414] "containerMap: removing container" podUID="1ffada0a-505d-4836-948f-0517674cc25b" containerName="maas-api"
Oct 31 00:43:29.046989 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.046989    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ffada0a-505d-4836-948f-0517674cc25b" containerName="maas-api"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047026    5925 cpu_manager.go:414] "containerMap: removing container" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047032    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047044    5925 cpu_manager.go:414] "containerMap: removing container" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047052    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047064    5925 cpu_manager.go:414] "containerMap: removing container" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047069    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047101    5925 cpu_manager.go:414] "containerMap: removing container" podUID="d9b326f7-dd63-474a-a2a3-40df1f544fe0" containerName="maas-api"
Oct 31 00:43:29.047158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047106    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9b326f7-dd63-474a-a2a3-40df1f544fe0" containerName="maas-api"
Oct 31 00:43:29.047506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047288    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ffada0a-505d-4836-948f-0517674cc25b" containerName="maas-api"
Oct 31 00:43:29.047506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047312    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="083fe01c-e7f8-43e5-9c89-d4537eac88a5" containerName="istio-proxy"
Oct 31 00:43:29.047506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047323    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="50d28b4f-7a5f-461f-a678-2f892711f2b1" containerName="istio-proxy"
Oct 31 00:43:29.047506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047334    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="52deace2-9bc5-489f-86bb-063c9dfc8408" containerName="istio-proxy"
Oct 31 00:43:29.047506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.047343    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9b326f7-dd63-474a-a2a3-40df1f544fe0" containerName="maas-api"
Oct 31 00:43:29.052322 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.052304    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.100663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.100630    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"]
Oct 31 00:43:29.105670 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.105641    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.111458 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.108972    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"]
Oct 31 00:43:29.114147 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.114119    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.114271 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.114186    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.114271 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.114237    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzmb\" (UniqueName: \"kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb\") pod \"payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.114385 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.114270    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v26j2\" (UniqueName: \"kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2\") pod \"payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.144588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.144541    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w0-f32ec2\""
Oct 31 00:43:29.169912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.169881    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w0-f32ec2-dockercfg-ttmwq\""
Oct 31 00:43:29.231766 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.231716    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.231956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.231776    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.231956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.231819    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzmb\" (UniqueName: \"kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb\") pod \"payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.231956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.231845    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v26j2\" (UniqueName: \"kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2\") pod \"payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.233249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.233202    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.233480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.233458    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.238688 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.238651    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"]
Oct 31 00:43:29.342487 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.304059    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v26j2\" (UniqueName: \"kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2\") pod \"payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.367437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.358925    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzmb\" (UniqueName: \"kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb\") pod \"payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.367437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.366224    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:29.442857 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.422406    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:29.871908 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.871871    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"]
Oct 31 00:43:29.876943 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:43:29.876912    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fda9f4f_804c_4bc7_b3e6_3febe7f6fce3.slice/crio-88efd98f3c45b05107a14c7035334c24982d5a61be481015deb99a55b9ea813a WatchSource:0}: Error finding container 88efd98f3c45b05107a14c7035334c24982d5a61be481015deb99a55b9ea813a: Status 404 returned error can't find the container with id 88efd98f3c45b05107a14c7035334c24982d5a61be481015deb99a55b9ea813a
Oct 31 00:43:29.892721 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:29.892684    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6" event={"ID":"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3","Type":"ContainerStarted","Data":"88efd98f3c45b05107a14c7035334c24982d5a61be481015deb99a55b9ea813a"}
Oct 31 00:43:30.067198 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.067168    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"]
Oct 31 00:43:30.072703 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.072681    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.074044 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.074019    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"]
Oct 31 00:43:30.090881 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.090846    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.091391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.090956    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbm2\" (UniqueName: \"kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.091391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.091005    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.091391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.091166    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.116638 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:43:30.116606    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e84ab8f_6026_4a18_9644_dae47c15c8a5.slice/crio-e5a920aed36607563f4ddf419d6bc903aeed8fe60f45d7053a57e7e81b41f898 WatchSource:0}: Error finding container e5a920aed36607563f4ddf419d6bc903aeed8fe60f45d7053a57e7e81b41f898: Status 404 returned error can't find the container with id e5a920aed36607563f4ddf419d6bc903aeed8fe60f45d7053a57e7e81b41f898
Oct 31 00:43:30.123055 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.123023    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-d58cd3-serving-cert\""
Oct 31 00:43:30.127452 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.127400    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"]
Oct 31 00:43:30.193325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.193284    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.193489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.193350    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbm2\" (UniqueName: \"kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.193489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.193390    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.193573 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.193521    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.193793 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:30.193775    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-serving-cert: secret "maas-api-e2e-shared-a-w2-d58cd3-serving-cert" not found
Oct 31 00:43:30.193855 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:30.193845    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls podName:b50ac5dd-d6b2-4f72-9f75-4984185fc93c nodeName:}" failed. No retries permitted until 2026-10-31 00:43:30.69382459 +0000 UTC m=+1712.382704532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls") pod "maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" (UID: "b50ac5dd-d6b2-4f72-9f75-4984185fc93c") : secret "maas-api-e2e-shared-a-w2-d58cd3-serving-cert" not found
Oct 31 00:43:30.194952 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.194922    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.197145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.197114    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.256480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.256445    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbm2\" (UniqueName: \"kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.500645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.500608    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.621958    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622011    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622121    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622194    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622298    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622328    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622390    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622495    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.633826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.622575    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss\") pod \"18ed26e6-5654-4104-b965-d8990a2afd53\" (UID: \"18ed26e6-5654-4104-b965-d8990a2afd53\") "
Oct 31 00:43:30.636125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.636086    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "kube-api-access-wcpss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:30.638049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.637862    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:30.638160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.638104    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:30.638221 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.638166    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:30.638668 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.638631    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:43:30.639062 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.639040    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:30.645098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.645069    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:43:30.645286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.645267    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:43:30.647597 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.647572    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token" pod "18ed26e6-5654-4104-b965-d8990a2afd53" (UID: "18ed26e6-5654-4104-b965-d8990a2afd53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:43:30.724091 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724052    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724168    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724179    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724187    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724196    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18ed26e6-5654-4104-b965-d8990a2afd53-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724207    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724215    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724224    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18ed26e6-5654-4104-b965-d8990a2afd53-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724231    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18ed26e6-5654-4104-b965-d8990a2afd53-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.724302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.724240    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcpss\" (UniqueName: \"kubernetes.io/projected/18ed26e6-5654-4104-b965-d8990a2afd53-kube-api-access-wcpss\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:43:30.726699 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.726661    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:30.901513 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.901392    5925 generic.go:356] "Generic (PLEG): container finished" podID="18ed26e6-5654-4104-b965-d8990a2afd53" containerID="0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57" exitCode=0
Oct 31 00:43:30.901513 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.901449    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" event={"ID":"18ed26e6-5654-4104-b965-d8990a2afd53","Type":"ContainerDied","Data":"0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57"}
Oct 31 00:43:30.901513 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.901478    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"
Oct 31 00:43:30.901513 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.901508    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l" event={"ID":"18ed26e6-5654-4104-b965-d8990a2afd53","Type":"ContainerDied","Data":"b3a400572a1263034430542bf463a8682e2a9f795cbeb9fd5805e783d25391b1"}
Oct 31 00:43:30.901850 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.901538    5925 scope.go:122] "RemoveContainer" containerID="0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57"
Oct 31 00:43:30.903231 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.903208    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6" event={"ID":"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3","Type":"ContainerStarted","Data":"b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c"}
Oct 31 00:43:30.903387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.903372    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:30.905302 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.905279    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6" event={"ID":"9e84ab8f-6026-4a18-9644-dae47c15c8a5","Type":"ContainerStarted","Data":"116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026"}
Oct 31 00:43:30.905470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.905326    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6" event={"ID":"9e84ab8f-6026-4a18-9644-dae47c15c8a5","Type":"ContainerStarted","Data":"e5a920aed36607563f4ddf419d6bc903aeed8fe60f45d7053a57e7e81b41f898"}
Oct 31 00:43:30.905470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.905400    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:30.914387 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.914365    5925 scope.go:122] "RemoveContainer" containerID="0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57"
Oct 31 00:43:30.914756 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:30.914736    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57\": container with ID starting with 0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57 not found: ID does not exist" containerID="0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57"
Oct 31 00:43:30.914832 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:30.914772    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57"} err="failed to get container status \"0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57\": rpc error: code = NotFound desc = could not find container \"0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57\": container with ID starting with 0b9bb721fb5b0977bac266006774458cfc83ff437ffee234cd580a59e1cb0e57 not found: ID does not exist"
Oct 31 00:43:31.026916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.026876    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:31.067546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.067505    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"]
Oct 31 00:43:31.079807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.079778    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-74c6ba99-openshift-default-65cd5b8f85-m746l"]
Oct 31 00:43:31.201103 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.200928    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6" podStartSLOduration=2.200906077 podStartE2EDuration="2.200906077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:31.197633592 +0000 UTC m=+1712.886513539" watchObservedRunningTime="2026-10-31 00:43:31.200906077 +0000 UTC m=+1712.889786023"
Oct 31 00:43:31.335542 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.335470    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6" podStartSLOduration=3.335448842 podStartE2EDuration="3.335448842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:31.330225438 +0000 UTC m=+1713.019105385" watchObservedRunningTime="2026-10-31 00:43:31.335448842 +0000 UTC m=+1713.024328789"
Oct 31 00:43:31.498485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.496371    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"]
Oct 31 00:43:31.501234 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:43:31.501197    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50ac5dd_d6b2_4f72_9f75_4984185fc93c.slice/crio-a4ca6285d8630b417463866ef6190b1615dc56ee08c9c7561df311cd7c5c7ddd WatchSource:0}: Error finding container a4ca6285d8630b417463866ef6190b1615dc56ee08c9c7561df311cd7c5c7ddd: Status 404 returned error can't find the container with id a4ca6285d8630b417463866ef6190b1615dc56ee08c9c7561df311cd7c5c7ddd
Oct 31 00:43:31.503664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.503641    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:43:31.914823 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:31.914779    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" event={"ID":"b50ac5dd-d6b2-4f72-9f75-4984185fc93c","Type":"ContainerStarted","Data":"a4ca6285d8630b417463866ef6190b1615dc56ee08c9c7561df311cd7c5c7ddd"}
Oct 31 00:43:32.456791 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:32.456758    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" path="/var/lib/kubelet/pods/18ed26e6-5654-4104-b965-d8990a2afd53/volumes"
Oct 31 00:43:32.924933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:32.924901    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" event={"ID":"b50ac5dd-d6b2-4f72-9f75-4984185fc93c","Type":"ContainerStarted","Data":"9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5"}
Oct 31 00:43:32.925121 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:32.925078    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:33.047977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:33.047904    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" podStartSLOduration=2.117204985 podStartE2EDuration="3.047884185s" totalImagesPullingTime="930.6792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:33.043981222 +0000 UTC m=+1714.732861168" watchObservedRunningTime="2026-10-31 00:43:33.047884185 +0000 UTC m=+1714.736764133"
Oct 31 00:43:38.937839 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:38.937765    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:43:41.132089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.132042    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"]
Oct 31 00:43:41.133172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.133142    5925 cpu_manager.go:414] "containerMap: removing container" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy"
Oct 31 00:43:41.133172 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.133170    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy"
Oct 31 00:43:41.133362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.133331    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="18ed26e6-5654-4104-b965-d8990a2afd53" containerName="istio-proxy"
Oct 31 00:43:41.138154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.138130    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.195378 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.192560    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"]
Oct 31 00:43:41.229241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.229209    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7d5f4de7-serving-cert\""
Oct 31 00:43:41.262261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.262224    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.262507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.262283    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.262507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.262370    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvn5q\" (UniqueName: \"kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.262507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.262406    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.364216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.364172    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.364441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.364264    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.364441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.364311    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvn5q\" (UniqueName: \"kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.364441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.364358    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.364736 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:41.364708    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-serving-cert: secret "maas-api-e2e-mt-7d5f4de7-serving-cert" not found
Oct 31 00:43:41.364845 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:41.364790    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls podName:ce430cb0-8433-45bc-aa63-7d1b704ec7d7 nodeName:}" failed. No retries permitted until 2026-10-31 00:43:41.864767968 +0000 UTC m=+1723.553647910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls") pod "maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" (UID: "ce430cb0-8433-45bc-aa63-7d1b704ec7d7") : secret "maas-api-e2e-mt-7d5f4de7-serving-cert" not found
Oct 31 00:43:41.365255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.365229    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.367348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.367318    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.426371 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.426298    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvn5q\" (UniqueName: \"kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.873116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.873078    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.875570 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.875541    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:41.919362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.919335    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:43:41.919566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:41.919400    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:43:42.099638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:42.099594    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:42.513286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:42.513206    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"]
Oct 31 00:43:42.520408 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:43:42.520378    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce430cb0_8433_45bc_aa63_7d1b704ec7d7.slice/crio-38b36aa5cc809e6813ce013db5187170bb7d5165a62927907f26ba6de84e537c WatchSource:0}: Error finding container 38b36aa5cc809e6813ce013db5187170bb7d5165a62927907f26ba6de84e537c: Status 404 returned error can't find the container with id 38b36aa5cc809e6813ce013db5187170bb7d5165a62927907f26ba6de84e537c
Oct 31 00:43:43.006784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:43.006741    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" event={"ID":"ce430cb0-8433-45bc-aa63-7d1b704ec7d7","Type":"ContainerStarted","Data":"38b36aa5cc809e6813ce013db5187170bb7d5165a62927907f26ba6de84e537c"}
Oct 31 00:43:44.016134 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:44.016090    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" event={"ID":"ce430cb0-8433-45bc-aa63-7d1b704ec7d7","Type":"ContainerStarted","Data":"65c13a8e79d496bd36ee3d0f78bef95ca53f8515188aecb938a7daf91af2c5e2"}
Oct 31 00:43:44.016621 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:44.016185    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:43:44.170991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:44.170937    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" podStartSLOduration=2.282036904 podStartE2EDuration="3.170921576s" totalImagesPullingTime="888.884672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:44.167922614 +0000 UTC m=+1725.856802561" watchObservedRunningTime="2026-10-31 00:43:44.170921576 +0000 UTC m=+1725.859801522"
Oct 31 00:43:46.546520 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:43:46.546476    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:43:50.030923 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:43:50.030891    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:44:16.557868 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:16.557830    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:44:27.749961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.749923    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"]
Oct 31 00:44:27.754692 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.754671    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.852017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.851979    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-f32ec2-serving-cert\""
Oct 31 00:44:27.857344 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.857315    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"]
Oct 31 00:44:27.875340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.875310    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.875550 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.875524    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.875656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.875586    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f984l\" (UniqueName: \"kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.875711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.875661    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.977134 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.977079    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.977341 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.977277    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.977462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.977344    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f984l\" (UniqueName: \"kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.977462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.977366    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.977589 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:27.977476    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-serving-cert: secret "maas-api-e2e-shared-a-w0-f32ec2-serving-cert" not found
Oct 31 00:44:27.977589 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:27.977568    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls podName:2ce6a928-8cd0-4ea5-a132-b3d90de6309a nodeName:}" failed. No retries permitted until 2026-10-31 00:44:28.477545123 +0000 UTC m=+1770.166425067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls") pod "maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" (UID: "2ce6a928-8cd0-4ea5-a132-b3d90de6309a") : secret "maas-api-e2e-shared-a-w0-f32ec2-serving-cert" not found
Oct 31 00:44:27.978175 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.978149    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:27.980078 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:27.980056    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:28.041786 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:28.041688    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f984l\" (UniqueName: \"kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:28.485052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:28.485010    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:28.487405 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:28.487385    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:28.670930 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:28.670900    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:29.051920 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:29.051879    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"]
Oct 31 00:44:29.057102 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:44:29.057068    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce6a928_8cd0_4ea5_a132_b3d90de6309a.slice/crio-8f3cd368e6e47dcb9fe6acc6a88fbd283f4160176cfeb540f178c55a9104449e WatchSource:0}: Error finding container 8f3cd368e6e47dcb9fe6acc6a88fbd283f4160176cfeb540f178c55a9104449e: Status 404 returned error can't find the container with id 8f3cd368e6e47dcb9fe6acc6a88fbd283f4160176cfeb540f178c55a9104449e
Oct 31 00:44:29.448649 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:29.448613    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" event={"ID":"2ce6a928-8cd0-4ea5-a132-b3d90de6309a","Type":"ContainerStarted","Data":"8f3cd368e6e47dcb9fe6acc6a88fbd283f4160176cfeb540f178c55a9104449e"}
Oct 31 00:44:30.459660 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:30.459620    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" event={"ID":"2ce6a928-8cd0-4ea5-a132-b3d90de6309a","Type":"ContainerStarted","Data":"694c597b371f40a4009aa1f3869f48ed6483955b0e4fd317fe60c249424e7a42"}
Oct 31 00:44:30.460141 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:30.459686    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:30.575161 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:30.575104    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" podStartSLOduration=2.685403279 podStartE2EDuration="3.575090227s" totalImagesPullingTime="889.686948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:30.57206716 +0000 UTC m=+1772.260947107" watchObservedRunningTime="2026-10-31 00:44:30.575090227 +0000 UTC m=+1772.263970171"
Oct 31 00:44:32.670210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:32.670173    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"]
Oct 31 00:44:32.670699 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:32.670432    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" podUID="7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" containerName="maas-api" containerID="cri-o://79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485" gracePeriod=30
Oct 31 00:44:33.021855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.021746    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:44:33.167442 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.163886    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp\") pod \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") "
Oct 31 00:44:33.167442 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.164235    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca\") pod \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") "
Oct 31 00:44:33.167442 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.164274    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs\") pod \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") "
Oct 31 00:44:33.167442 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.164299    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\") pod \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\" (UID: \"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d\") "
Oct 31 00:44:33.167442 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.165544    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca" pod "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" (UID: "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:44:33.182709 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.182648    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls" pod "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" (UID: "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:44:33.185591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.185557    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs" pod "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" (UID: "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:44:33.185793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.185562    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp" pod "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" (UID: "7109fc2a-8c0c-4032-9ad0-f0199cac1d0d"). InnerVolumeSpecName "kube-api-access-lrxsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:44:33.267999 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.267889    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrxsp\" (UniqueName: \"kubernetes.io/projected/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-kube-api-access-lrxsp\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:44:33.268248 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.268223    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:44:33.268509 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.268486    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:44:33.268761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.268743    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:44:33.483641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.483604    5925 generic.go:356] "Generic (PLEG): container finished" podID="7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" containerID="79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485" exitCode=0
Oct 31 00:44:33.483829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.483658    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"
Oct 31 00:44:33.483829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.483682    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" event={"ID":"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d","Type":"ContainerDied","Data":"79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485"}
Oct 31 00:44:33.483829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.483743    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf" event={"ID":"7109fc2a-8c0c-4032-9ad0-f0199cac1d0d","Type":"ContainerDied","Data":"2170c2170d78234088d1507e7669276a482332144d73c0b53803349b9b24eabd"}
Oct 31 00:44:33.483829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.483773    5925 scope.go:122] "RemoveContainer" containerID="79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485"
Oct 31 00:44:33.495336 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.495317    5925 scope.go:122] "RemoveContainer" containerID="79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485"
Oct 31 00:44:33.495632 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:33.495611    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485\": container with ID starting with 79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485 not found: ID does not exist" containerID="79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485"
Oct 31 00:44:33.495718 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.495638    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485"} err="failed to get container status \"79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485\": rpc error: code = NotFound desc = could not find container \"79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485\": container with ID starting with 79b2337a2bce4a165d7240a89c9724aea361d0d6830fbfb0ca53317e72c71485 not found: ID does not exist"
Oct 31 00:44:33.646010 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.645959    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"]
Oct 31 00:44:33.651403 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:33.651372    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f0651cac-7c4b9b786f-wqkqf"]
Oct 31 00:44:34.454970 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.454936    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" path="/var/lib/kubelet/pods/7109fc2a-8c0c-4032-9ad0-f0199cac1d0d/volumes"
Oct 31 00:44:34.455457 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.455301    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"]
Oct 31 00:44:34.456002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.455974    5925 cpu_manager.go:414] "containerMap: removing container" podUID="7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" containerName="maas-api"
Oct 31 00:44:34.456002 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.455996    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" containerName="maas-api"
Oct 31 00:44:34.456168 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.456146    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="7109fc2a-8c0c-4032-9ad0-f0199cac1d0d" containerName="maas-api"
Oct 31 00:44:34.461057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.461038    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.563193 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.563158    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"]
Oct 31 00:44:34.579225 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.579191    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w4-0da668-serving-cert\""
Oct 31 00:44:34.588020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.587971    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.588182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.588050    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.588249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.588214    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.588332 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.588309    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpkx6\" (UniqueName: \"kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.689372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.689338    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.689586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.689398    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.689586 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.689532    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.689711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.689602    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpkx6\" (UniqueName: \"kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.690016 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:34.689988    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-serving-cert: secret "maas-api-e2e-shared-b-w4-0da668-serving-cert" not found
Oct 31 00:44:34.690152 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:34.690059    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls podName:6b056407-8ecf-43b3-ae8f-a257ea081b84 nodeName:}" failed. No retries permitted until 2026-10-31 00:44:35.19003824 +0000 UTC m=+1776.878918167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls") pod "maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" (UID: "6b056407-8ecf-43b3-ae8f-a257ea081b84") : secret "maas-api-e2e-shared-b-w4-0da668-serving-cert" not found
Oct 31 00:44:34.690217 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.690170    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.692396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.692373    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:34.796039 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:34.795959    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpkx6\" (UniqueName: \"kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:35.199241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:35.199199    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:35.201771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:35.201746    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:35.375203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:35.375173    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:35.757152 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:35.757114    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"]
Oct 31 00:44:35.762102 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:44:35.762074    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b056407_8ecf_43b3_ae8f_a257ea081b84.slice/crio-31197ce904dc731196d3b04ca088c616394719c3d167961480e46dbcc9ba3a7f WatchSource:0}: Error finding container 31197ce904dc731196d3b04ca088c616394719c3d167961480e46dbcc9ba3a7f: Status 404 returned error can't find the container with id 31197ce904dc731196d3b04ca088c616394719c3d167961480e46dbcc9ba3a7f
Oct 31 00:44:36.473897 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:36.473869    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:44:36.507406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:36.507374    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" event={"ID":"6b056407-8ecf-43b3-ae8f-a257ea081b84","Type":"ContainerStarted","Data":"31197ce904dc731196d3b04ca088c616394719c3d167961480e46dbcc9ba3a7f"}
Oct 31 00:44:37.516755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:37.516715    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" event={"ID":"6b056407-8ecf-43b3-ae8f-a257ea081b84","Type":"ContainerStarted","Data":"3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664"}
Oct 31 00:44:37.517232 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:37.516780    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:37.645970 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:37.645740    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" podStartSLOduration=2.668723923 podStartE2EDuration="3.645720316s" totalImagesPullingTime="976.996393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:37.642176979 +0000 UTC m=+1779.331056924" watchObservedRunningTime="2026-10-31 00:44:37.645720316 +0000 UTC m=+1779.334600263"
Oct 31 00:44:40.040098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.040060    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"]
Oct 31 00:44:40.045162 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.045137    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.095253 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.095228    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w6-e030e0-serving-cert\""
Oct 31 00:44:40.115424 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.115377    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4mrt\" (UniqueName: \"kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.115554 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.115425    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.115554 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.115513    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.115663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.115645    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.148582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.148550    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"]
Oct 31 00:44:40.217088 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.217055    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4mrt\" (UniqueName: \"kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.217268 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.217097    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.217268 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.217220    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.217390 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.217357    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.217390 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:40.217362    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-serving-cert: secret "maas-api-e2e-shared-a-w6-e030e0-serving-cert" not found
Oct 31 00:44:40.217542 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:40.217472    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls podName:3d51ef82-4055-47e6-9aec-69fdb0b6972d nodeName:}" failed. No retries permitted until 2026-10-31 00:44:40.717448287 +0000 UTC m=+1782.406328228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls") pod "maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" (UID: "3d51ef82-4055-47e6-9aec-69fdb0b6972d") : secret "maas-api-e2e-shared-a-w6-e030e0-serving-cert" not found
Oct 31 00:44:40.217936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.217914    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.219557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.219535    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.279374 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.279289    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4mrt\" (UniqueName: \"kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.725829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.725788    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.728349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.728324    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\") pod \"maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:40.959685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:40.959651    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:41.354695 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:41.354661    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"]
Oct 31 00:44:41.547226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:41.547186    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" event={"ID":"3d51ef82-4055-47e6-9aec-69fdb0b6972d","Type":"ContainerStarted","Data":"6be64c5b4b8749f6f575904b3cc5b4b694c977668bf7236808813ec4fe166f65"}
Oct 31 00:44:42.573945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:42.573844    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" event={"ID":"3d51ef82-4055-47e6-9aec-69fdb0b6972d","Type":"ContainerStarted","Data":"caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c"}
Oct 31 00:44:42.573945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:42.573925    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:42.687345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:42.687289    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" podStartSLOduration=2.8610520900000003 podStartE2EDuration="3.68727495s" totalImagesPullingTime="826.22286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:42.686191932 +0000 UTC m=+1784.375071878" watchObservedRunningTime="2026-10-31 00:44:42.68727495 +0000 UTC m=+1784.376154895"
Oct 31 00:44:43.531246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:43.531217    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 00:44:46.550569 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:44:46.550527    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:44:48.587982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:48.587949    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:44:58.762169 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:58.762137    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:44:58.769125 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:44:58.769099    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:45:16.545275 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:45:16.545183    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:45:46.548466 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:45:46.548410    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:45:48.014903 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.014868    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"]
Oct 31 00:45:48.019504 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.019468    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.069593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.069568    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-5b4db8-serving-cert\""
Oct 31 00:45:48.123017 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.122980    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"]
Oct 31 00:45:48.166122 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.166088    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hn98\" (UniqueName: \"kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.166364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.166343    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.166711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.166694    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.166930 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.166914    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.285487 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.284845    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hn98\" (UniqueName: \"kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.285487 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.284899    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.285487 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.285142    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.285487 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.285216    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.299209 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.299150    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.303210 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.303015    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.303751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.303521    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.357763 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.357729    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hn98\" (UniqueName: \"kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98\") pod \"maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:48.634108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:48.634075    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:49.017802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:49.017624    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"]
Oct 31 00:45:49.202739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:49.202702    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4" event={"ID":"8c9e243d-6dac-4eda-9909-e9f17fe49aad","Type":"ContainerStarted","Data":"32f10c70b34c6d331d8b53c75ed6c81e3e86f1334f44c96cbc55cdfddacc738c"}
Oct 31 00:45:50.211179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:50.211087    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4" event={"ID":"8c9e243d-6dac-4eda-9909-e9f17fe49aad","Type":"ContainerStarted","Data":"6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc"}
Oct 31 00:45:50.211664 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:50.211191    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:45:50.335027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:50.334972    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4" podStartSLOduration=2.455207633 podStartE2EDuration="3.334959702s" totalImagesPullingTime="879.752069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:50.333798496 +0000 UTC m=+1852.022678442" watchObservedRunningTime="2026-10-31 00:45:50.334959702 +0000 UTC m=+1852.023839646"
Oct 31 00:45:56.223769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:45:56.223734    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:46:15.410792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.410757    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"]
Oct 31 00:46:15.416781 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.416757    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.514620 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.514585    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f891e6-serving-cert\""
Oct 31 00:46:15.518824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.518791    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.518972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.518866    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.518972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.518902    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvc7x\" (UniqueName: \"kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.519178 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.519153    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.520853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.520825    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"]
Oct 31 00:46:15.620295 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.620262    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.620529 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:46:15.620389    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-serving-cert: secret "maas-api-e2e-api-a-f891e6-serving-cert" not found
Oct 31 00:46:15.620529 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:46:15.620499    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls podName:d8efb4c2-24e5-4d83-acdf-d37afe991f27 nodeName:}" failed. No retries permitted until 2026-10-31 00:46:16.12047713 +0000 UTC m=+1877.809357073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls") pod "maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" (UID: "d8efb4c2-24e5-4d83-acdf-d37afe991f27") : secret "maas-api-e2e-api-a-f891e6-serving-cert" not found
Oct 31 00:46:15.620801 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.620777    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.620910 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.620846    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.620910 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.620880    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvc7x\" (UniqueName: \"kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.622106 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.622078    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.625979 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.625956    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:15.679461 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:15.679375    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvc7x\" (UniqueName: \"kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:16.132567 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:16.132526    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:16.135065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:16.135045    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\") pod \"maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:16.339764 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:16.332856    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:16.549323 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:46:16.549274    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:46:16.727260 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:16.727178    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"]
Oct 31 00:46:16.732606 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:46:16.732577    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8efb4c2_24e5_4d83_acdf_d37afe991f27.slice/crio-7289d55a7f48512f42a8a91652acd4ceedea4fac9dbd0cf4218b9595793aaec1 WatchSource:0}: Error finding container 7289d55a7f48512f42a8a91652acd4ceedea4fac9dbd0cf4218b9595793aaec1: Status 404 returned error can't find the container with id 7289d55a7f48512f42a8a91652acd4ceedea4fac9dbd0cf4218b9595793aaec1
Oct 31 00:46:17.440813 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:17.440781    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" event={"ID":"d8efb4c2-24e5-4d83-acdf-d37afe991f27","Type":"ContainerStarted","Data":"7289d55a7f48512f42a8a91652acd4ceedea4fac9dbd0cf4218b9595793aaec1"}
Oct 31 00:46:18.455623 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:18.455595    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:18.455996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:18.455639    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" event={"ID":"d8efb4c2-24e5-4d83-acdf-d37afe991f27","Type":"ContainerStarted","Data":"26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5"}
Oct 31 00:46:18.571477 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:18.571403    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" podStartSLOduration=2.7101940190000002 podStartE2EDuration="3.571388946s" totalImagesPullingTime="861.194927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:18.566336835 +0000 UTC m=+1880.255216779" watchObservedRunningTime="2026-10-31 00:46:18.571388946 +0000 UTC m=+1880.260268891"
Oct 31 00:46:24.479425 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:24.479395    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:46:25.977184 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:25.977150    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"]
Oct 31 00:46:25.983237 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:25.983215    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.036310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.036285    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-dcdbd0-serving-cert\""
Oct 31 00:46:26.086598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.086558    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"]
Oct 31 00:46:26.092701 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.091483    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.092701 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.091541    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgpfs\" (UniqueName: \"kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.092701 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.091795    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.092701 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.091838    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.193048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.193017    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.193230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.193062    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.193230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.193148    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.193230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.193168    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgpfs\" (UniqueName: \"kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.193888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.193860    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.195690 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.195666    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.195793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.195694    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.251979 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.251902    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgpfs\" (UniqueName: \"kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs\") pod \"maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.297676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.297644    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:26.756880 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:26.756846    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"]
Oct 31 00:46:26.760590 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:46:26.760560    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfeee73_d078_4074_80e3_3dd2680300e9.slice/crio-0779d27b76b7cdfbc177b63b1a45bb6011b5ace2bd9eb125a3273dffcecc0143 WatchSource:0}: Error finding container 0779d27b76b7cdfbc177b63b1a45bb6011b5ace2bd9eb125a3273dffcecc0143: Status 404 returned error can't find the container with id 0779d27b76b7cdfbc177b63b1a45bb6011b5ace2bd9eb125a3273dffcecc0143
Oct 31 00:46:27.533305 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:27.533269    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld" event={"ID":"ebfeee73-d078-4074-80e3-3dd2680300e9","Type":"ContainerStarted","Data":"0779d27b76b7cdfbc177b63b1a45bb6011b5ace2bd9eb125a3273dffcecc0143"}
Oct 31 00:46:28.544840 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:28.544805    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld" event={"ID":"ebfeee73-d078-4074-80e3-3dd2680300e9","Type":"ContainerStarted","Data":"44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b"}
Oct 31 00:46:28.545320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:28.544977    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:28.658540 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:28.658483    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld" podStartSLOduration=2.614087251 podStartE2EDuration="3.65847021s" totalImagesPullingTime="1.044382959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:28.656941768 +0000 UTC m=+1890.345821713" watchObservedRunningTime="2026-10-31 00:46:28.65847021 +0000 UTC m=+1890.347350154"
Oct 31 00:46:34.561824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:46:34.561793    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:46:46.545106 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:46:46.545058    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:47:16.570958 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:47:16.570923    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:47:28.666956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.666919    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"]
Oct 31 00:47:28.672057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.672030    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.723984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.723932    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w0-e9c3c1-serving-cert\""
Oct 31 00:47:28.730286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.730258    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.730463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.730380    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.730651 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.730630    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.730739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.730722    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q29j8\" (UniqueName: \"kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.778764 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.778720    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"]
Oct 31 00:47:28.784408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.784372    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"]
Oct 31 00:47:28.784576 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.784504    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.833963 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.833919    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.834141 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.833984    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.834141 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.834021    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.835991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.835961    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.836148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836037    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q29j8\" (UniqueName: \"kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.836148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836077    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.836148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836109    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.836148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836140    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sz8p\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.836544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836185    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.836544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836215    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.836733 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.836690    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.836964 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:47:28.836946    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-serving-cert: secret "maas-api-e2e-shared-b-w0-e9c3c1-serving-cert" not found
Oct 31 00:47:28.837124 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:47:28.837111    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls podName:37c94c6a-9d05-44e5-889d-7600c5a98bf1 nodeName:}" failed. No retries permitted until 2026-10-31 00:47:29.337090079 +0000 UTC m=+1951.025970022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls") pod "maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" (UID: "37c94c6a-9d05-44e5-889d-7600c5a98bf1") : secret "maas-api-e2e-shared-b-w0-e9c3c1-serving-cert" not found
Oct 31 00:47:28.837311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.837292    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.837528 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.837364    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.837669 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.837512    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.838083 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.838053    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.843951 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.842088    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"]
Oct 31 00:47:28.895498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.895465    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q29j8\" (UniqueName: \"kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.960890    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5b4db8-openshift-default-dockercfg-tc2fm\""
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.961878    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.961978    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962090    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962127    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962188    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962259    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962287    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sz8p\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962329    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962359    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.963486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.962861    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.970211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.967687    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.970211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.968238    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.970211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.968538    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.971473 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.970825    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.971473 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.971072    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:28.975528 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:28.975338    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:29.026570 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.026530    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:29.027996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.027967    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sz8p\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p\") pod \"e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") " pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:29.110575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.109472    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:29.367704 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.367662    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:29.370075 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.370048    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\") pod \"maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:29.567843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.567803    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"]
Oct 31 00:47:29.576291 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:47:29.576259    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f901144_1cdf_4096_af9e_0494e5ad8402.slice/crio-89e2593639950ea67db1f0d39c495af974f8b1ca49e1844c255e4f2746798969 WatchSource:0}: Error finding container 89e2593639950ea67db1f0d39c495af974f8b1ca49e1844c255e4f2746798969: Status 404 returned error can't find the container with id 89e2593639950ea67db1f0d39c495af974f8b1ca49e1844c255e4f2746798969
Oct 31 00:47:29.579872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.579832    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:47:29.579988 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.579928    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:47:29.579988 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.579968    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:47:29.587578 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:29.587552    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:30.087193 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:30.087163    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"]
Oct 31 00:47:30.095112 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:47:30.092081    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c94c6a_9d05_44e5_889d_7600c5a98bf1.slice/crio-a64015eb55c925cd3f271e6053e6eb3c6da371c00744d8059cf339927938a8ea WatchSource:0}: Error finding container a64015eb55c925cd3f271e6053e6eb3c6da371c00744d8059cf339927938a8ea: Status 404 returned error can't find the container with id a64015eb55c925cd3f271e6053e6eb3c6da371c00744d8059cf339927938a8ea
Oct 31 00:47:30.126282 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:30.126252    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" event={"ID":"37c94c6a-9d05-44e5-889d-7600c5a98bf1","Type":"ContainerStarted","Data":"a64015eb55c925cd3f271e6053e6eb3c6da371c00744d8059cf339927938a8ea"}
Oct 31 00:47:30.128099 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:30.128075    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" event={"ID":"3f901144-1cdf-4096-af9e-0494e5ad8402","Type":"ContainerStarted","Data":"15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520"}
Oct 31 00:47:30.128211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:30.128120    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" event={"ID":"3f901144-1cdf-4096-af9e-0494e5ad8402","Type":"ContainerStarted","Data":"89e2593639950ea67db1f0d39c495af974f8b1ca49e1844c255e4f2746798969"}
Oct 31 00:47:30.250435 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:30.249640    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podStartSLOduration=2.249620228 podStartE2EDuration="2.249620228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:47:30.243860708 +0000 UTC m=+1951.932740655" watchObservedRunningTime="2026-10-31 00:47:30.249620228 +0000 UTC m=+1951.938500174"
Oct 31 00:47:31.110602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:31.110533    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:31.112230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:31.112201    5925 patch_prober.go:29] interesting pod/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 31 00:47:31.112347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:31.112260    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 31 00:47:31.142158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:31.141776    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" event={"ID":"37c94c6a-9d05-44e5-889d-7600c5a98bf1","Type":"ContainerStarted","Data":"9b547fd4c71c547a7ea4a0be892accc535dbc2693cdff7090305e87d955aa8b1"}
Oct 31 00:47:31.142158 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:31.141863    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:31.272124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:31.271675    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" podStartSLOduration=2.381771111 podStartE2EDuration="3.271660918s" totalImagesPullingTime="889.889807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:47:31.270866446 +0000 UTC m=+1952.959746393" watchObservedRunningTime="2026-10-31 00:47:31.271660918 +0000 UTC m=+1952.960540886"
Oct 31 00:47:32.116435 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:32.113507    5925 patch_prober.go:29] interesting pod/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 31 00:47:32.116435 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:32.113577    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 31 00:47:33.110398 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:33.110356    5925 patch_prober.go:29] interesting pod/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 31 00:47:33.110631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:33.110443    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 31 00:47:34.110146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:34.110113    5925 patch_prober.go:29] interesting pod/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 31 00:47:34.110592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:34.110167    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 31 00:47:35.110067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:35.110034    5925 patch_prober.go:29] interesting pod/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 31 00:47:35.110247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:35.110094    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 31 00:47:36.115955 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:36.115925    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:36.116402 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:36.116389    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:36.116984 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:36.116966    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:47:37.183471 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:37.183441    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:47:46.544070 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:47:46.544031    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:47:55.101423 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.101375    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"]
Oct 31 00:47:55.106391 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.106368    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.156672 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.156630    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w6-2594a9-serving-cert\""
Oct 31 00:47:55.173853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.173814    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjthz\" (UniqueName: \"kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.174023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.173882    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.174088 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.174056    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.174149 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.174111    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.209188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.209155    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"]
Oct 31 00:47:55.275977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.275936    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjthz\" (UniqueName: \"kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.276157 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.276006    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.276157 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.276100    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.276157 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.276153    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.277208 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:47:55.277183    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-serving-cert: secret "maas-api-e2e-shared-b-w6-2594a9-serving-cert" not found
Oct 31 00:47:55.277505 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.277431    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.277505 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:47:55.277461    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls podName:ede65313-a03b-477e-8cb2-3e101ca6c7ae nodeName:}" failed. No retries permitted until 2026-10-31 00:47:55.777402314 +0000 UTC m=+1977.466282252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls") pod "maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" (UID: "ede65313-a03b-477e-8cb2-3e101ca6c7ae") : secret "maas-api-e2e-shared-b-w6-2594a9-serving-cert" not found
Oct 31 00:47:55.280325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.280283    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.336030 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.336003    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjthz\" (UniqueName: \"kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.812886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.812844    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:55.815313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:55.815291    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:56.019970 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:56.019933    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:47:56.438742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:56.438658    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"]
Oct 31 00:47:56.444336 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:47:56.444306    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede65313_a03b_477e_8cb2_3e101ca6c7ae.slice/crio-0282e328fc1990c7483adc43d306c88f6bba233c5f777ee4cb48da1a1df34b7e WatchSource:0}: Error finding container 0282e328fc1990c7483adc43d306c88f6bba233c5f777ee4cb48da1a1df34b7e: Status 404 returned error can't find the container with id 0282e328fc1990c7483adc43d306c88f6bba233c5f777ee4cb48da1a1df34b7e
Oct 31 00:47:57.418995 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:57.418954    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" event={"ID":"ede65313-a03b-477e-8cb2-3e101ca6c7ae","Type":"ContainerStarted","Data":"0282e328fc1990c7483adc43d306c88f6bba233c5f777ee4cb48da1a1df34b7e"}
Oct 31 00:47:58.538264 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:58.538200    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" event={"ID":"ede65313-a03b-477e-8cb2-3e101ca6c7ae","Type":"ContainerStarted","Data":"de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a"}
Oct 31 00:47:58.639850 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:58.639782    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" podStartSLOduration=2.589470723 podStartE2EDuration="3.639768089s" totalImagesPullingTime="1.050297366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:47:58.637628963 +0000 UTC m=+1980.326508908" watchObservedRunningTime="2026-10-31 00:47:58.639768089 +0000 UTC m=+1980.328648034"
Oct 31 00:47:59.475171 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:47:59.475139    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:48:05.552737 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:05.552633    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:48:16.545534 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:48:16.545490    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:48:46.545276 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:48:46.545233    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:48:47.011809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:47.011770    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"]
Oct 31 00:48:47.012025 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:47.011997    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" containerID="cri-o://ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857" gracePeriod=30
Oct 31 00:48:48.119834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.119799    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"]
Oct 31 00:48:48.120260 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.120024    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" containerID="cri-o://17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289" gracePeriod=30
Oct 31 00:48:48.548807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.548720    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:48.548959 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.548820    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:48.656948 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.656909    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"]
Oct 31 00:48:48.657240 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.657196    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" containerID="cri-o://24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a" gracePeriod=30
Oct 31 00:48:48.691081 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.691036    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"]
Oct 31 00:48:48.691341 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:48.691297    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" containerID="cri-o://ea5546cc29b79301f42c22f2bcb472a5d0fe7390101b8519dc15d78b5a2428c4" gracePeriod=30
Oct 31 00:48:50.979608 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:50.979574    5925 patch_prober.go:29] interesting pod/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:50.980051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:50.979630    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:52.298205 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.298131    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:48:52.360661 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.360616    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.360856 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.360682    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.360928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.360848    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.360928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.360900    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.361046 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.360974    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.361046 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361024    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.361145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361053    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.361145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361099    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.361145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361114    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:52.361145 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361138    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs\") pod \"6cd9406f-7698-40e5-88d1-36056858ff5e\" (UID: \"6cd9406f-7698-40e5-88d1-36056858ff5e\") "
Oct 31 00:48:52.361374 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.360988    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:52.361681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361628    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:52.361681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361648    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:52.361681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.361675    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:52.362085 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.362066    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.362166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.362088    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.362166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.362104    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd9406f-7698-40e5-88d1-36056858ff5e-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.362166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.362118    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.362166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.362131    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.363216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.363193    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:52.363553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.363528    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:52.363722 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.363698    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:52.363815 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.363738    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9" pod "6cd9406f-7698-40e5-88d1-36056858ff5e" (UID: "6cd9406f-7698-40e5-88d1-36056858ff5e"). InnerVolumeSpecName "kube-api-access-7x4v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:52.387443 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.387387    5925 patch_prober.go:29] interesting pod/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:52.387592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.387484    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:52.463188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.463163    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.463279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.463190    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.463279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.463200    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x4v9\" (UniqueName: \"kubernetes.io/projected/6cd9406f-7698-40e5-88d1-36056858ff5e-kube-api-access-7x4v9\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.463279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.463211    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd9406f-7698-40e5-88d1-36056858ff5e-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:52.796489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.796453    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:52.796685 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.796510    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:52.988474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.988401    5925 generic.go:356] "Generic (PLEG): container finished" podID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerID="ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857" exitCode=0
Oct 31 00:48:52.988681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.988488    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"
Oct 31 00:48:52.988681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.988489    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" event={"ID":"6cd9406f-7698-40e5-88d1-36056858ff5e","Type":"ContainerDied","Data":"ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857"}
Oct 31 00:48:52.988681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.988555    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc" event={"ID":"6cd9406f-7698-40e5-88d1-36056858ff5e","Type":"ContainerDied","Data":"2add712c18d0da9a189548dbb77260baefcc068fe93fbfd04d9ccf4c2a880eaa"}
Oct 31 00:48:52.988681 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:52.988582    5925 scope.go:122] "RemoveContainer" containerID="ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857"
Oct 31 00:48:53.000124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.000098    5925 scope.go:122] "RemoveContainer" containerID="ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857"
Oct 31 00:48:53.000453 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:48:53.000431    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857\": container with ID starting with ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857 not found: ID does not exist" containerID="ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857"
Oct 31 00:48:53.000558 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.000461    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857"} err="failed to get container status \"ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857\": rpc error: code = NotFound desc = could not find container \"ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857\": container with ID starting with ff100b765b4087f308a009d55a222e186a5d8fd4120cde1fce96c7b02b671857 not found: ID does not exist"
Oct 31 00:48:53.161822 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.161779    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"]
Oct 31 00:48:53.165582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.165552    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-xf6mc"]
Oct 31 00:48:53.408073 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.408046    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:48:53.480945 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.480915    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.480990    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481085    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481124 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481115    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481167    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481239    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481380    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481482    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.481734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481508    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.481734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481542    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:53.481734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481553    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data\") pod \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\" (UID: \"d945f2ec-44ad-4b24-b81a-89fa845c71f6\") "
Oct 31 00:48:53.482104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481737    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.482104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481830    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.482104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.481998    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.482272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.482157    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.482272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.482172    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.482272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.482181    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.482272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.482190    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.482272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.482198    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.483808 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.483733    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.483946 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.483851    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.483946 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.483863    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "kube-api-access-v2rmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.484033 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.483936    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo" pod "d945f2ec-44ad-4b24-b81a-89fa845c71f6" (UID: "d945f2ec-44ad-4b24-b81a-89fa845c71f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:53.583615 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.583566    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.583615 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.583602    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.583615 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.583617    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2rmw\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-kube-api-access-v2rmw\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.583947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.583633    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d945f2ec-44ad-4b24-b81a-89fa845c71f6-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.968491 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:53.968462    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:48:54.002266 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.002236    5925 generic.go:356] "Generic (PLEG): container finished" podID="d03aae54-4e55-43fa-a27b-f520babe5576" containerID="ea5546cc29b79301f42c22f2bcb472a5d0fe7390101b8519dc15d78b5a2428c4" exitCode=0
Oct 31 00:48:54.002471 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.002309    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" event={"ID":"d03aae54-4e55-43fa-a27b-f520babe5576","Type":"ContainerDied","Data":"ea5546cc29b79301f42c22f2bcb472a5d0fe7390101b8519dc15d78b5a2428c4"}
Oct 31 00:48:54.004092 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.004047    5925 generic.go:356] "Generic (PLEG): container finished" podID="2174b6fa-8559-4333-8748-442074cd5941" containerID="24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a" exitCode=0
Oct 31 00:48:54.004179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.004119    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" event={"ID":"2174b6fa-8559-4333-8748-442074cd5941","Type":"ContainerDied","Data":"24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a"}
Oct 31 00:48:54.004179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.004155    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh" event={"ID":"2174b6fa-8559-4333-8748-442074cd5941","Type":"ContainerDied","Data":"6a2af668ad863b43a9a9659005350c2e633711f6eb3226f0b2c77f6f45edfa8c"}
Oct 31 00:48:54.004179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.004123    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"
Oct 31 00:48:54.004342 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.004183    5925 scope.go:122] "RemoveContainer" containerID="24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a"
Oct 31 00:48:54.005720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.005698    5925 generic.go:356] "Generic (PLEG): container finished" podID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerID="17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289" exitCode=0
Oct 31 00:48:54.005892 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.005876    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"
Oct 31 00:48:54.008700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.006503    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" event={"ID":"d945f2ec-44ad-4b24-b81a-89fa845c71f6","Type":"ContainerDied","Data":"17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289"}
Oct 31 00:48:54.008700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.006566    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw" event={"ID":"d945f2ec-44ad-4b24-b81a-89fa845c71f6","Type":"ContainerDied","Data":"ee72a274fb4cd6b4cf186c992e11ff59fbd2f5f261d8a249e4b583f6823d7c35"}
Oct 31 00:48:54.014502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.014480    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:48:54.018854 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.018836    5925 scope.go:122] "RemoveContainer" containerID="24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a"
Oct 31 00:48:54.019124 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:48:54.019106    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a\": container with ID starting with 24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a not found: ID does not exist" containerID="24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a"
Oct 31 00:48:54.019173 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.019132    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a"} err="failed to get container status \"24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a\": rpc error: code = NotFound desc = could not find container \"24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a\": container with ID starting with 24c3403b277791c858cc9204fd8837e0f374b0a67bddc3b0ed9f5e8f6b5e347a not found: ID does not exist"
Oct 31 00:48:54.019173 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.019150    5925 scope.go:122] "RemoveContainer" containerID="17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289"
Oct 31 00:48:54.028862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.028841    5925 scope.go:122] "RemoveContainer" containerID="17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289"
Oct 31 00:48:54.029117 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:48:54.029098    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289\": container with ID starting with 17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289 not found: ID does not exist" containerID="17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289"
Oct 31 00:48:54.029180 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.029123    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289"} err="failed to get container status \"17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289\": rpc error: code = NotFound desc = could not find container \"17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289\": container with ID starting with 17e57d276f582fb6dd3cffa5fee1cfb0d701c47ce1afe71fd2dc163af3331289 not found: ID does not exist"
Oct 31 00:48:54.099571 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099538    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.099742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099583    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.099742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099631    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.099742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099673    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.099742 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099710    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.099949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099746    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.099949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099852    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.099949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099890    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.099949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099920    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.100126 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.099959    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.100293 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.100265    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.100343 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.100313    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:54.100502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.100483    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.100667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.100644    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.100928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.100904    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.101230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.101185    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.101230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.101200    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.103072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.103049    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "kube-api-access-wbjrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:54.103670 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.103646    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.104111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104077    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.104512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104487    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.104600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104544    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.104600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104591    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.104754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104635    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.104754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104674    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.104754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104718    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.104754 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104744    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token\") pod \"d03aae54-4e55-43fa-a27b-f520babe5576\" (UID: \"d03aae54-4e55-43fa-a27b-f520babe5576\") "
Oct 31 00:48:54.104947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104756    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.104947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.104799    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo\") pod \"2174b6fa-8559-4333-8748-442074cd5941\" (UID: \"2174b6fa-8559-4333-8748-442074cd5941\") "
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105541    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105567    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105581    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105595    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105610    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105624    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2174b6fa-8559-4333-8748-442074cd5941-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105641    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105655    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105669    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbjrq\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-kube-api-access-wbjrq\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105684    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105687    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:54.105719 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105698    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2174b6fa-8559-4333-8748-442074cd5941-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.106267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.105776    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:54.107605 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.107579    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:54.108061 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.108039    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token" pod "d03aae54-4e55-43fa-a27b-f520babe5576" (UID: "d03aae54-4e55-43fa-a27b-f520babe5576"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:54.108316 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.108282    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:54.108437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.108395    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "kube-api-access-vmw7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:54.109853 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.109830    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token" pod "2174b6fa-8559-4333-8748-442074cd5941" (UID: "2174b6fa-8559-4333-8748-442074cd5941"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206846    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d03aae54-4e55-43fa-a27b-f520babe5576-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206876    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d03aae54-4e55-43fa-a27b-f520babe5576-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206887    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d03aae54-4e55-43fa-a27b-f520babe5576-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206896    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmw7w\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-kube-api-access-vmw7w\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206907    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2174b6fa-8559-4333-8748-442074cd5941-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206916    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d03aae54-4e55-43fa-a27b-f520babe5576-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.206926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.206926    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2174b6fa-8559-4333-8748-442074cd5941-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:54.246116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.246070    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"]
Oct 31 00:48:54.250801 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.250774    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-clnbw"]
Oct 31 00:48:54.454623 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.454587    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" path="/var/lib/kubelet/pods/6cd9406f-7698-40e5-88d1-36056858ff5e/volumes"
Oct 31 00:48:54.455197 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.455180    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" path="/var/lib/kubelet/pods/d945f2ec-44ad-4b24-b81a-89fa845c71f6/volumes"
Oct 31 00:48:54.472126 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.472100    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"]
Oct 31 00:48:54.486202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:54.486170    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-8d2dh"]
Oct 31 00:48:55.018696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:55.018661    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"
Oct 31 00:48:55.018899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:55.018695    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb" event={"ID":"d03aae54-4e55-43fa-a27b-f520babe5576","Type":"ContainerDied","Data":"03a3e982c34fd25f92724afc89c34e2c461ebde6dd8f2ef1efcdfd668010155f"}
Oct 31 00:48:55.018899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:55.018806    5925 scope.go:122] "RemoveContainer" containerID="ea5546cc29b79301f42c22f2bcb472a5d0fe7390101b8519dc15d78b5a2428c4"
Oct 31 00:48:55.181515 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:55.181480    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"]
Oct 31 00:48:55.226735 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:55.226689    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-p7bzb"]
Oct 31 00:48:56.455800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:56.455762    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2174b6fa-8559-4333-8748-442074cd5941" path="/var/lib/kubelet/pods/2174b6fa-8559-4333-8748-442074cd5941/volumes"
Oct 31 00:48:56.456271 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:56.456257    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" path="/var/lib/kubelet/pods/d03aae54-4e55-43fa-a27b-f520babe5576/volumes"
Oct 31 00:48:57.623893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:57.623856    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"]
Oct 31 00:48:57.624395 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:48:57.624059    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy" containerID="cri-o://5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda" gracePeriod=30
Oct 31 00:49:02.928396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:02.928367    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:49:03.033164 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033128    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033211    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033240    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033357 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033329    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033357    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033466    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033551 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033546    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033613    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:03.033700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033671    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033818 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033763    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7\") pod \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\" (UID: \"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9\") "
Oct 31 00:49:03.033872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033847    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:03.034008 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.033983    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:03.034093 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034026    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:03.034247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034227    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:03.034547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034523    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.034702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034554    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.034702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034571    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.034702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034586    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.034702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.034603    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.035774 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.035730    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:03.036003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.035986    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:03.036245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.036227    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "kube-api-access-nw8r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:03.036617 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.036601    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token" pod "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" (UID: "144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:03.094752 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.094710    5925 generic.go:356] "Generic (PLEG): container finished" podID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerID="5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda" exitCode=0
Oct 31 00:49:03.094947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.094801    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"
Oct 31 00:49:03.094947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.094766    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" event={"ID":"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9","Type":"ContainerDied","Data":"5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda"}
Oct 31 00:49:03.094947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.094908    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc" event={"ID":"144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9","Type":"ContainerDied","Data":"e3daea4f10aa5158a5fa3a560f07dd998c2157d7b3e95cd98c944e25f9ccfcad"}
Oct 31 00:49:03.095116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.094954    5925 scope.go:122] "RemoveContainer" containerID="5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda"
Oct 31 00:49:03.143279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.140227    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.143279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.140266    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.143279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.140290    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.143279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.140306    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw8r7\" (UniqueName: \"kubernetes.io/projected/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9-kube-api-access-nw8r7\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:03.164989 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.164963    5925 scope.go:122] "RemoveContainer" containerID="5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda"
Oct 31 00:49:03.167695 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:03.167657    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda\": container with ID starting with 5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda not found: ID does not exist" containerID="5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda"
Oct 31 00:49:03.167819 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.167705    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda"} err="failed to get container status \"5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda\": rpc error: code = NotFound desc = could not find container \"5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda\": container with ID starting with 5a74f57a11dccea75007acf3b4a822d2011222860c00a7a7a4648ab6ae53dcda not found: ID does not exist"
Oct 31 00:49:03.261659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.261622    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"]
Oct 31 00:49:03.266015 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:03.265979    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-m47hc"]
Oct 31 00:49:04.456532 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:04.456494    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" path="/var/lib/kubelet/pods/144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9/volumes"
Oct 31 00:49:08.284679 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:08.284632    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"]
Oct 31 00:49:08.393321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:08.393284    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"]
Oct 31 00:49:13.295440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.288494    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6" podUID="9e84ab8f-6026-4a18-9644-dae47c15c8a5" containerName="payload-processing" containerID="cri-o://116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026" gracePeriod=25
Oct 31 00:49:13.394503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.394441    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6" podUID="5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" containerName="payload-pre-processing" containerID="cri-o://b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c" gracePeriod=25
Oct 31 00:49:13.609383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.609354    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:49:13.656463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.652293    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb\" (UniqueName: \"kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb\") pod \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") "
Oct 31 00:49:13.656463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.652472    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume\") pod \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\" (UID: \"9e84ab8f-6026-4a18-9644-dae47c15c8a5\") "
Oct 31 00:49:13.656463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.653155    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume" pod "9e84ab8f-6026-4a18-9644-dae47c15c8a5" (UID: "9e84ab8f-6026-4a18-9644-dae47c15c8a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:13.661236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.661201    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb" pod "9e84ab8f-6026-4a18-9644-dae47c15c8a5" (UID: "9e84ab8f-6026-4a18-9644-dae47c15c8a5"). InnerVolumeSpecName "kube-api-access-lwzmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:13.699547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.699521    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:49:13.753679 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.753642    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2\" (UniqueName: \"kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2\") pod \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") "
Oct 31 00:49:13.753862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.753835    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume\") pod \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\" (UID: \"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3\") "
Oct 31 00:49:13.754320 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.754283    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume" pod "5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" (UID: "5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:13.754546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.754524    5925 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e84ab8f-6026-4a18-9644-dae47c15c8a5-plugins-config-volume\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:13.754656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.754551    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwzmb\" (UniqueName: \"kubernetes.io/projected/9e84ab8f-6026-4a18-9644-dae47c15c8a5-kube-api-access-lwzmb\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:13.754656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.754566    5925 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-plugins-config-volume\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:13.756450 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.756406    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2" pod "5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" (UID: "5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3"). InnerVolumeSpecName "kube-api-access-v26j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:13.774502 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.774460    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"]
Oct 31 00:49:13.775813 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775786    5925 cpu_manager.go:414] "containerMap: removing container" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy"
Oct 31 00:49:13.775933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775829    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy"
Oct 31 00:49:13.775933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775843    5925 cpu_manager.go:414] "containerMap: removing container" podUID="5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" containerName="payload-pre-processing"
Oct 31 00:49:13.775933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775851    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" containerName="payload-pre-processing"
Oct 31 00:49:13.775933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775933    5925 cpu_manager.go:414] "containerMap: removing container" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775942    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775957    5925 cpu_manager.go:414] "containerMap: removing container" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.775981    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776002    5925 cpu_manager.go:414] "containerMap: removing container" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776012    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776030    5925 cpu_manager.go:414] "containerMap: removing container" podUID="9e84ab8f-6026-4a18-9644-dae47c15c8a5" containerName="payload-processing"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776037    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e84ab8f-6026-4a18-9644-dae47c15c8a5" containerName="payload-processing"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776073    5925 cpu_manager.go:414] "containerMap: removing container" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy"
Oct 31 00:49:13.776286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776081    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776275    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="2174b6fa-8559-4333-8748-442074cd5941" containerName="istio-proxy"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776308    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="144a0bd3-b6f2-4dc8-bd95-bf6dc9bd35e9" containerName="istio-proxy"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776320    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="d03aae54-4e55-43fa-a27b-f520babe5576" containerName="istio-proxy"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776329    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e84ab8f-6026-4a18-9644-dae47c15c8a5" containerName="payload-processing"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776349    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="d945f2ec-44ad-4b24-b81a-89fa845c71f6" containerName="istio-proxy"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776379    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cd9406f-7698-40e5-88d1-36056858ff5e" containerName="istio-proxy"
Oct 31 00:49:13.776731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.776395    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" containerName="payload-pre-processing"
Oct 31 00:49:13.782557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.782532    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.834711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.834680    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-50a19d-serving-cert\""
Oct 31 00:49:13.845622 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.845585    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"]
Oct 31 00:49:13.855936 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.855896    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.856129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.855973    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgkxz\" (UniqueName: \"kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.856129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.856060    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.856245 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.856134    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.856296 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.856260    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v26j2\" (UniqueName: \"kubernetes.io/projected/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3-kube-api-access-v26j2\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:13.957951 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.957902    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.958163 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.958002    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgkxz\" (UniqueName: \"kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.958163 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.958112    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.958277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.958203    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.959111 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:13.959086    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-serving-cert: secret "maas-api-e2e-api-b-50a19d-serving-cert" not found
Oct 31 00:49:13.959295 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:13.959162    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls podName:a25fa42d-95af-49ba-be70-bc778c833e0e nodeName:}" failed. No retries permitted until 2026-10-31 00:49:14.459139678 +0000 UTC m=+2056.148019624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls") pod "maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" (UID: "a25fa42d-95af-49ba-be70-bc778c833e0e") : secret "maas-api-e2e-api-b-50a19d-serving-cert" not found
Oct 31 00:49:13.960047 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.960018    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:13.961873 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:13.961848    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:14.024368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.021201    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgkxz\" (UniqueName: \"kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:14.180319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.180225    5925 generic.go:356] "Generic (PLEG): container finished" podID="5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" containerID="b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c" exitCode=0
Oct 31 00:49:14.180319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.180272    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"
Oct 31 00:49:14.180319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.180305    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6" event={"ID":"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3","Type":"ContainerDied","Data":"b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c"}
Oct 31 00:49:14.180687 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.180363    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6" event={"ID":"5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3","Type":"ContainerDied","Data":"88efd98f3c45b05107a14c7035334c24982d5a61be481015deb99a55b9ea813a"}
Oct 31 00:49:14.180687 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.180396    5925 scope.go:122] "RemoveContainer" containerID="b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c"
Oct 31 00:49:14.182346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.182213    5925 generic.go:356] "Generic (PLEG): container finished" podID="9e84ab8f-6026-4a18-9644-dae47c15c8a5" containerID="116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026" exitCode=0
Oct 31 00:49:14.182346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.182269    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"
Oct 31 00:49:14.182346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.182307    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6" event={"ID":"9e84ab8f-6026-4a18-9644-dae47c15c8a5","Type":"ContainerDied","Data":"116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026"}
Oct 31 00:49:14.182640 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.182359    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6" event={"ID":"9e84ab8f-6026-4a18-9644-dae47c15c8a5","Type":"ContainerDied","Data":"e5a920aed36607563f4ddf419d6bc903aeed8fe60f45d7053a57e7e81b41f898"}
Oct 31 00:49:14.194067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.194042    5925 scope.go:122] "RemoveContainer" containerID="b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c"
Oct 31 00:49:14.196234 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:14.194686    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c\": container with ID starting with b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c not found: ID does not exist" containerID="b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c"
Oct 31 00:49:14.196234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.194744    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c"} err="failed to get container status \"b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c\": rpc error: code = NotFound desc = could not find container \"b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c\": container with ID starting with b8f4fd3de1199cb51758a9cd9601a4d8b770a30286513e666e3f7d8a6944ca1c not found: ID does not exist"
Oct 31 00:49:14.196234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.194769    5925 scope.go:122] "RemoveContainer" containerID="116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026"
Oct 31 00:49:14.206127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.206104    5925 scope.go:122] "RemoveContainer" containerID="116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026"
Oct 31 00:49:14.206492 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:14.206472    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026\": container with ID starting with 116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026 not found: ID does not exist" containerID="116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026"
Oct 31 00:49:14.206570 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.206501    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026"} err="failed to get container status \"116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026\": rpc error: code = NotFound desc = could not find container \"116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026\": container with ID starting with 116906fe2019f3034555bec05e3e1fc9a15a5377bd75cb25a7c03b13bda8a026 not found: ID does not exist"
Oct 31 00:49:14.343299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.343270    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"]
Oct 31 00:49:14.348295 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.348261    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w0-f32ec2-79c9797c5f-mllx6"]
Oct 31 00:49:14.455368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.455284    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e84ab8f-6026-4a18-9644-dae47c15c8a5" path="/var/lib/kubelet/pods/9e84ab8f-6026-4a18-9644-dae47c15c8a5/volumes"
Oct 31 00:49:14.455677 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.455660    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"]
Oct 31 00:49:14.458820 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.458788    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w0-f32ec2-85b9c79d79-kzhp6"]
Oct 31 00:49:14.468542 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.468509    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:14.470966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.470941    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\") pod \"maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:14.699592 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:14.699561    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:15.089051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:15.089010    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"]
Oct 31 00:49:15.095912 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:49:15.095875    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25fa42d_95af_49ba_be70_bc778c833e0e.slice/crio-4a63c7b8ce0201232d9cce3fad3524bcce6c212e9d9b7d8472c1454c40bd91d9 WatchSource:0}: Error finding container 4a63c7b8ce0201232d9cce3fad3524bcce6c212e9d9b7d8472c1454c40bd91d9: Status 404 returned error can't find the container with id 4a63c7b8ce0201232d9cce3fad3524bcce6c212e9d9b7d8472c1454c40bd91d9
Oct 31 00:49:15.097857 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:15.097832    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:49:15.195874 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:15.195835    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" event={"ID":"a25fa42d-95af-49ba-be70-bc778c833e0e","Type":"ContainerStarted","Data":"4a63c7b8ce0201232d9cce3fad3524bcce6c212e9d9b7d8472c1454c40bd91d9"}
Oct 31 00:49:16.454181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:16.454098    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3" path="/var/lib/kubelet/pods/5fda9f4f-804c-4bc7-b3e6-3febe7f6fce3/volumes"
Oct 31 00:49:16.545229 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:16.545187    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:49:17.241613 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:17.241560    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" event={"ID":"a25fa42d-95af-49ba-be70-bc778c833e0e","Type":"ContainerStarted","Data":"5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942"}
Oct 31 00:49:17.242758 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:17.242732    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:17.358508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:17.358450    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" podStartSLOduration=3.335493053 podStartE2EDuration="4.358435388s" totalImagesPullingTime="1.022942335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:49:17.356731722 +0000 UTC m=+2059.045611668" watchObservedRunningTime="2026-10-31 00:49:17.358435388 +0000 UTC m=+2059.047315330"
Oct 31 00:49:24.264815 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.264782    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:49:24.295294 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.295260    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"]
Oct 31 00:49:24.295505 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.295484    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" podUID="b50ac5dd-d6b2-4f72-9f75-4984185fc93c" containerName="maas-api" containerID="cri-o://9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5" gracePeriod=30
Oct 31 00:49:24.691563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.691533    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:49:24.715474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.714123    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2\" (UniqueName: \"kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2\") pod \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") "
Oct 31 00:49:24.715474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.714186    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca\") pod \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") "
Oct 31 00:49:24.715474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.714243    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\") pod \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") "
Oct 31 00:49:24.715474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.714290    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs\") pod \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\" (UID: \"b50ac5dd-d6b2-4f72-9f75-4984185fc93c\") "
Oct 31 00:49:24.717658 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.717615    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs" pod "b50ac5dd-d6b2-4f72-9f75-4984185fc93c" (UID: "b50ac5dd-d6b2-4f72-9f75-4984185fc93c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:24.719700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.719624    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca" pod "b50ac5dd-d6b2-4f72-9f75-4984185fc93c" (UID: "b50ac5dd-d6b2-4f72-9f75-4984185fc93c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:24.726446 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.725654    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2" pod "b50ac5dd-d6b2-4f72-9f75-4984185fc93c" (UID: "b50ac5dd-d6b2-4f72-9f75-4984185fc93c"). InnerVolumeSpecName "kube-api-access-kjbm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:24.768715 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.756609    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls" pod "b50ac5dd-d6b2-4f72-9f75-4984185fc93c" (UID: "b50ac5dd-d6b2-4f72-9f75-4984185fc93c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:24.816750 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.816699    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjbm2\" (UniqueName: \"kubernetes.io/projected/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-kube-api-access-kjbm2\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:24.817023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.817002    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:24.817130 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.817119    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:24.817235 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:24.817222    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b50ac5dd-d6b2-4f72-9f75-4984185fc93c-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:25.302266 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.302230    5925 generic.go:356] "Generic (PLEG): container finished" podID="b50ac5dd-d6b2-4f72-9f75-4984185fc93c" containerID="9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5" exitCode=0
Oct 31 00:49:25.302780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.302273    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" event={"ID":"b50ac5dd-d6b2-4f72-9f75-4984185fc93c","Type":"ContainerDied","Data":"9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5"}
Oct 31 00:49:25.302780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.302278    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"
Oct 31 00:49:25.302780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.302342    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5" event={"ID":"b50ac5dd-d6b2-4f72-9f75-4984185fc93c","Type":"ContainerDied","Data":"a4ca6285d8630b417463866ef6190b1615dc56ee08c9c7561df311cd7c5c7ddd"}
Oct 31 00:49:25.302780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.302365    5925 scope.go:122] "RemoveContainer" containerID="9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5"
Oct 31 00:49:25.321177 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.321149    5925 scope.go:122] "RemoveContainer" containerID="9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5"
Oct 31 00:49:25.321461 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:25.321440    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5\": container with ID starting with 9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5 not found: ID does not exist" containerID="9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5"
Oct 31 00:49:25.321523 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.321471    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5"} err="failed to get container status \"9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5\": rpc error: code = NotFound desc = could not find container \"9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5\": container with ID starting with 9627c70154ee120f5b51fbab2a8982830ab6f41342bfa20a2a75d9108e8422a5 not found: ID does not exist"
Oct 31 00:49:25.465704 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.465669    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"]
Oct 31 00:49:25.513771 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:25.513730    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d58cd3-b5579795c-vbmd5"]
Oct 31 00:49:26.455013 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:26.454977    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b50ac5dd-d6b2-4f72-9f75-4984185fc93c" path="/var/lib/kubelet/pods/b50ac5dd-d6b2-4f72-9f75-4984185fc93c/volumes"
Oct 31 00:49:37.958216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:37.957886    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"]
Oct 31 00:49:37.958216 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:37.958160    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" podUID="d8efb4c2-24e5-4d83-acdf-d37afe991f27" containerName="maas-api" containerID="cri-o://26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5" gracePeriod=30
Oct 31 00:49:38.280884 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.280852    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:49:38.302153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.302114    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x\" (UniqueName: \"kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x\") pod \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") "
Oct 31 00:49:38.302294 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.302272    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\") pod \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") "
Oct 31 00:49:38.302408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.302394    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs\") pod \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") "
Oct 31 00:49:38.302568 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.302549    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca\") pod \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\" (UID: \"d8efb4c2-24e5-4d83-acdf-d37afe991f27\") "
Oct 31 00:49:38.303001 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.302972    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca" pod "d8efb4c2-24e5-4d83-acdf-d37afe991f27" (UID: "d8efb4c2-24e5-4d83-acdf-d37afe991f27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:38.303267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.303242    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8efb4c2-24e5-4d83-acdf-d37afe991f27-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:38.304637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.304607    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls" pod "d8efb4c2-24e5-4d83-acdf-d37afe991f27" (UID: "d8efb4c2-24e5-4d83-acdf-d37afe991f27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:38.304731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.304643    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x" pod "d8efb4c2-24e5-4d83-acdf-d37afe991f27" (UID: "d8efb4c2-24e5-4d83-acdf-d37afe991f27"). InnerVolumeSpecName "kube-api-access-tvc7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:38.305013 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.304995    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs" pod "d8efb4c2-24e5-4d83-acdf-d37afe991f27" (UID: "d8efb4c2-24e5-4d83-acdf-d37afe991f27"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:38.404408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.404373    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvc7x\" (UniqueName: \"kubernetes.io/projected/d8efb4c2-24e5-4d83-acdf-d37afe991f27-kube-api-access-tvc7x\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:38.404408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.404402    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:38.404408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.404424    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8efb4c2-24e5-4d83-acdf-d37afe991f27-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:38.421765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.421676    5925 generic.go:356] "Generic (PLEG): container finished" podID="d8efb4c2-24e5-4d83-acdf-d37afe991f27" containerID="26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5" exitCode=0
Oct 31 00:49:38.421765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.421726    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"
Oct 31 00:49:38.422202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.421776    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" event={"ID":"d8efb4c2-24e5-4d83-acdf-d37afe991f27","Type":"ContainerDied","Data":"26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5"}
Oct 31 00:49:38.422202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.421854    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz" event={"ID":"d8efb4c2-24e5-4d83-acdf-d37afe991f27","Type":"ContainerDied","Data":"7289d55a7f48512f42a8a91652acd4ceedea4fac9dbd0cf4218b9595793aaec1"}
Oct 31 00:49:38.422202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.421888    5925 scope.go:122] "RemoveContainer" containerID="26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5"
Oct 31 00:49:38.444052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.443633    5925 scope.go:122] "RemoveContainer" containerID="26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5"
Oct 31 00:49:38.455182 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:38.455094    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5\": container with ID starting with 26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5 not found: ID does not exist" containerID="26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5"
Oct 31 00:49:38.455182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.455144    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5"} err="failed to get container status \"26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5\": rpc error: code = NotFound desc = could not find container \"26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5\": container with ID starting with 26e99c02aa7512b04ed5128f7663046e14858c63af0cbba4f530db3fdbd2a1b5 not found: ID does not exist"
Oct 31 00:49:38.599433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.599277    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"]
Oct 31 00:49:38.604627 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:38.604597    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f891e6-7c97684cc4-2lwxz"]
Oct 31 00:49:39.237268 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.237235    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"]
Oct 31 00:49:39.237702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.237495    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" podUID="ce430cb0-8433-45bc-aa63-7d1b704ec7d7" containerName="maas-api" containerID="cri-o://65c13a8e79d496bd36ee3d0f78bef95ca53f8515188aecb938a7daf91af2c5e2" gracePeriod=30
Oct 31 00:49:39.441098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.440941    5925 generic.go:356] "Generic (PLEG): container finished" podID="ce430cb0-8433-45bc-aa63-7d1b704ec7d7" containerID="65c13a8e79d496bd36ee3d0f78bef95ca53f8515188aecb938a7daf91af2c5e2" exitCode=0
Oct 31 00:49:39.441098 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.441040    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" event={"ID":"ce430cb0-8433-45bc-aa63-7d1b704ec7d7","Type":"ContainerDied","Data":"65c13a8e79d496bd36ee3d0f78bef95ca53f8515188aecb938a7daf91af2c5e2"}
Oct 31 00:49:39.560048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.560016    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:49:39.635377 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.635345    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\") pod \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") "
Oct 31 00:49:39.635617 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.635472    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q\" (UniqueName: \"kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q\") pod \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") "
Oct 31 00:49:39.635702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.635630    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs\") pod \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") "
Oct 31 00:49:39.635702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.635675    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca\") pod \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\" (UID: \"ce430cb0-8433-45bc-aa63-7d1b704ec7d7\") "
Oct 31 00:49:39.637235 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.637203    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca" pod "ce430cb0-8433-45bc-aa63-7d1b704ec7d7" (UID: "ce430cb0-8433-45bc-aa63-7d1b704ec7d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:39.644470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.640982    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs" pod "ce430cb0-8433-45bc-aa63-7d1b704ec7d7" (UID: "ce430cb0-8433-45bc-aa63-7d1b704ec7d7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:39.663436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.649772    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls" pod "ce430cb0-8433-45bc-aa63-7d1b704ec7d7" (UID: "ce430cb0-8433-45bc-aa63-7d1b704ec7d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:39.663436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.656735    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q" pod "ce430cb0-8433-45bc-aa63-7d1b704ec7d7" (UID: "ce430cb0-8433-45bc-aa63-7d1b704ec7d7"). InnerVolumeSpecName "kube-api-access-qvn5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:39.737961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.737933    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:39.737961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.737961    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvn5q\" (UniqueName: \"kubernetes.io/projected/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-kube-api-access-qvn5q\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:39.737961 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.737975    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:39.738280 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:39.737988    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce430cb0-8433-45bc-aa63-7d1b704ec7d7-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:40.453299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:40.453265    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"
Oct 31 00:49:40.454913 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:40.454888    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8efb4c2-24e5-4d83-acdf-d37afe991f27" path="/var/lib/kubelet/pods/d8efb4c2-24e5-4d83-acdf-d37afe991f27/volumes"
Oct 31 00:49:40.455463 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:40.455423    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv" event={"ID":"ce430cb0-8433-45bc-aa63-7d1b704ec7d7","Type":"ContainerDied","Data":"38b36aa5cc809e6813ce013db5187170bb7d5165a62927907f26ba6de84e537c"}
Oct 31 00:49:40.455614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:40.455491    5925 scope.go:122] "RemoveContainer" containerID="65c13a8e79d496bd36ee3d0f78bef95ca53f8515188aecb938a7daf91af2c5e2"
Oct 31 00:49:40.613640 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:40.613602    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"]
Oct 31 00:49:40.660066 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:40.660030    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-qrswv"]
Oct 31 00:49:42.455324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:42.455286    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce430cb0-8433-45bc-aa63-7d1b704ec7d7" path="/var/lib/kubelet/pods/ce430cb0-8433-45bc-aa63-7d1b704ec7d7/volumes"
Oct 31 00:49:46.572163 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:49:46.572127    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:49:54.818957 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:54.818912    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"]
Oct 31 00:49:58.825609 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:58.825578    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:49:58.832150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:49:58.832122    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:50:04.387566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:04.387530    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"]
Oct 31 00:50:09.388805 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.388758    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx" podUID="c9885498-ddf0-499e-b943-6ada0b147c8f" containerName="payload-pre-processing" containerID="cri-o://bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d" gracePeriod=25
Oct 31 00:50:09.699213 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.699179    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:50:09.710396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.710369    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6\" (UniqueName: \"kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6\") pod \"c9885498-ddf0-499e-b943-6ada0b147c8f\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") "
Oct 31 00:50:09.710553 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.710539    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume\") pod \"c9885498-ddf0-499e-b943-6ada0b147c8f\" (UID: \"c9885498-ddf0-499e-b943-6ada0b147c8f\") "
Oct 31 00:50:09.710963 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.710933    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume" pod "c9885498-ddf0-499e-b943-6ada0b147c8f" (UID: "c9885498-ddf0-499e-b943-6ada0b147c8f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:50:09.711123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.711106    5925 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9885498-ddf0-499e-b943-6ada0b147c8f-plugins-config-volume\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:09.712544 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.712512    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6" pod "c9885498-ddf0-499e-b943-6ada0b147c8f" (UID: "c9885498-ddf0-499e-b943-6ada0b147c8f"). InnerVolumeSpecName "kube-api-access-dkzf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:50:09.796470 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.796435    5925 generic.go:356] "Generic (PLEG): container finished" podID="c9885498-ddf0-499e-b943-6ada0b147c8f" containerID="bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d" exitCode=0
Oct 31 00:50:09.796654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.796488    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"
Oct 31 00:50:09.796654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.796518    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx" event={"ID":"c9885498-ddf0-499e-b943-6ada0b147c8f","Type":"ContainerDied","Data":"bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d"}
Oct 31 00:50:09.796654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.796589    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx" event={"ID":"c9885498-ddf0-499e-b943-6ada0b147c8f","Type":"ContainerDied","Data":"c22c44b21c2c8da4abf287076734ad14960cf9ce682f1bb7c89eee30a319bf15"}
Oct 31 00:50:09.796654 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.796612    5925 scope.go:122] "RemoveContainer" containerID="bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d"
Oct 31 00:50:09.807638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.807622    5925 scope.go:122] "RemoveContainer" containerID="bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d"
Oct 31 00:50:09.807880 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:50:09.807864    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d\": container with ID starting with bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d not found: ID does not exist" containerID="bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d"
Oct 31 00:50:09.807918 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.807888    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d"} err="failed to get container status \"bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d\": rpc error: code = NotFound desc = could not find container \"bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d\": container with ID starting with bd2947a745978439554c031cbfc4ce13d1e1de0018974476002256a4fc219a8d not found: ID does not exist"
Oct 31 00:50:09.812512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.812489    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkzf6\" (UniqueName: \"kubernetes.io/projected/c9885498-ddf0-499e-b943-6ada0b147c8f-kube-api-access-dkzf6\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:09.848916 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.848877    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main" containerID="cri-o://bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b" gracePeriod=45
Oct 31 00:50:09.920107 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.920041    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"]
Oct 31 00:50:09.926127 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:09.926102    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-982ae3-6b6857b7dc-92pzx"]
Oct 31 00:50:10.110178 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.110153    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:50:10.115870 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.115841    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm\") pod \"27401dfd-ad05-4055-8e63-6445894bc55b\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") "
Oct 31 00:50:10.115987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.115938    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home\") pod \"27401dfd-ad05-4055-8e63-6445894bc55b\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") "
Oct 31 00:50:10.115987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.115973    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts\" (UniqueName: \"kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts\") pod \"27401dfd-ad05-4055-8e63-6445894bc55b\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") "
Oct 31 00:50:10.116072 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116026    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache\") pod \"27401dfd-ad05-4055-8e63-6445894bc55b\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") "
Oct 31 00:50:10.116220 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116198    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home" pod "27401dfd-ad05-4055-8e63-6445894bc55b" (UID: "27401dfd-ad05-4055-8e63-6445894bc55b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:10.116220 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116214    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir\") pod \"27401dfd-ad05-4055-8e63-6445894bc55b\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") "
Oct 31 00:50:10.116345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116247    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs\" (UniqueName: \"kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs\") pod \"27401dfd-ad05-4055-8e63-6445894bc55b\" (UID: \"27401dfd-ad05-4055-8e63-6445894bc55b\") "
Oct 31 00:50:10.116345 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116330    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache" pod "27401dfd-ad05-4055-8e63-6445894bc55b" (UID: "27401dfd-ad05-4055-8e63-6445894bc55b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:10.116534 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116444    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir" pod "27401dfd-ad05-4055-8e63-6445894bc55b" (UID: "27401dfd-ad05-4055-8e63-6445894bc55b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:10.116744 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116722    5925 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-model-cache\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:10.116844 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116767    5925 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-tmp-dir\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:10.116844 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.116778    5925 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-home\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:10.118108 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.118082    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm" pod "27401dfd-ad05-4055-8e63-6445894bc55b" (UID: "27401dfd-ad05-4055-8e63-6445894bc55b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:50:10.118230 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.118212    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts" pod "27401dfd-ad05-4055-8e63-6445894bc55b" (UID: "27401dfd-ad05-4055-8e63-6445894bc55b"). InnerVolumeSpecName "kube-api-access-srpts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:50:10.118299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.118281    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs" pod "27401dfd-ad05-4055-8e63-6445894bc55b" (UID: "27401dfd-ad05-4055-8e63-6445894bc55b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:50:10.217832 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.217750    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srpts\" (UniqueName: \"kubernetes.io/projected/27401dfd-ad05-4055-8e63-6445894bc55b-kube-api-access-srpts\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:10.217832 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.217781    5925 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27401dfd-ad05-4055-8e63-6445894bc55b-tls-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:10.217832 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.217791    5925 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27401dfd-ad05-4055-8e63-6445894bc55b-dshm\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:10.457593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.457557    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c9885498-ddf0-499e-b943-6ada0b147c8f" path="/var/lib/kubelet/pods/c9885498-ddf0-499e-b943-6ada0b147c8f/volumes"
Oct 31 00:50:10.806311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.806280    5925 generic.go:356] "Generic (PLEG): container finished" podID="27401dfd-ad05-4055-8e63-6445894bc55b" containerID="bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b" exitCode=0
Oct 31 00:50:10.806533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.806329    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"
Oct 31 00:50:10.806533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.806346    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" event={"ID":"27401dfd-ad05-4055-8e63-6445894bc55b","Type":"ContainerDied","Data":"bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b"}
Oct 31 00:50:10.806533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.806380    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4" event={"ID":"27401dfd-ad05-4055-8e63-6445894bc55b","Type":"ContainerDied","Data":"5d55a039846e75e5d79088d07ccab4f32e6204828777f9e4408306f48ef1092d"}
Oct 31 00:50:10.806533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.806397    5925 scope.go:122] "RemoveContainer" containerID="bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b"
Oct 31 00:50:10.816934 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.816906    5925 scope.go:122] "RemoveContainer" containerID="bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b"
Oct 31 00:50:10.817203 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:50:10.817182    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b\": container with ID starting with bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b not found: ID does not exist" containerID="bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b"
Oct 31 00:50:10.817259 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.817212    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b"} err="failed to get container status \"bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b\": rpc error: code = NotFound desc = could not find container \"bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b\": container with ID starting with bc78917aca02a3bbc7d98ee856a2b9d977845c08b2bcd7e88cd2ec80aaca3e5b not found: ID does not exist"
Oct 31 00:50:10.967347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:10.967311    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"]
Oct 31 00:50:11.012445 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:11.012402    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-982ae3/distinct-2-w1-982ae3-kserve-6f48c6dfcf-f28r4"]
Oct 31 00:50:12.456338 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:12.456303    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" path="/var/lib/kubelet/pods/27401dfd-ad05-4055-8e63-6445894bc55b/volumes"
Oct 31 00:50:16.545097 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:50:16.545054    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:50:28.694235 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:28.694200    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"]
Oct 31 00:50:28.694886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:28.694406    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" podUID="2ce6a928-8cd0-4ea5-a132-b3d90de6309a" containerName="maas-api" containerID="cri-o://694c597b371f40a4009aa1f3869f48ed6483955b0e4fd317fe60c249424e7a42" gracePeriod=30
Oct 31 00:50:28.965578 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:28.965484    5925 generic.go:356] "Generic (PLEG): container finished" podID="2ce6a928-8cd0-4ea5-a132-b3d90de6309a" containerID="694c597b371f40a4009aa1f3869f48ed6483955b0e4fd317fe60c249424e7a42" exitCode=0
Oct 31 00:50:28.965982 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:28.965806    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" event={"ID":"2ce6a928-8cd0-4ea5-a132-b3d90de6309a","Type":"ContainerDied","Data":"694c597b371f40a4009aa1f3869f48ed6483955b0e4fd317fe60c249424e7a42"}
Oct 31 00:50:29.019837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.019805    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:50:29.084225 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.084187    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca\") pod \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") "
Oct 31 00:50:29.084460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.084286    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs\") pod \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") "
Oct 31 00:50:29.084460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.084347    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l\" (UniqueName: \"kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l\") pod \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") "
Oct 31 00:50:29.084604 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.084514    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\") pod \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\" (UID: \"2ce6a928-8cd0-4ea5-a132-b3d90de6309a\") "
Oct 31 00:50:29.084700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.084676    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca" pod "2ce6a928-8cd0-4ea5-a132-b3d90de6309a" (UID: "2ce6a928-8cd0-4ea5-a132-b3d90de6309a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:50:29.085115 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.085087    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:29.086646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.086619    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs" pod "2ce6a928-8cd0-4ea5-a132-b3d90de6309a" (UID: "2ce6a928-8cd0-4ea5-a132-b3d90de6309a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:50:29.086769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.086716    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls" pod "2ce6a928-8cd0-4ea5-a132-b3d90de6309a" (UID: "2ce6a928-8cd0-4ea5-a132-b3d90de6309a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:50:29.086829 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.086796    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l" pod "2ce6a928-8cd0-4ea5-a132-b3d90de6309a" (UID: "2ce6a928-8cd0-4ea5-a132-b3d90de6309a"). InnerVolumeSpecName "kube-api-access-f984l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:50:29.186922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.186880    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:29.186922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.186912    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:29.186922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.186923    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f984l\" (UniqueName: \"kubernetes.io/projected/2ce6a928-8cd0-4ea5-a132-b3d90de6309a-kube-api-access-f984l\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:29.976227 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.976195    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"
Oct 31 00:50:29.976227 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.976216    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7" event={"ID":"2ce6a928-8cd0-4ea5-a132-b3d90de6309a","Type":"ContainerDied","Data":"8f3cd368e6e47dcb9fe6acc6a88fbd283f4160176cfeb540f178c55a9104449e"}
Oct 31 00:50:29.976824 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:29.976280    5925 scope.go:122] "RemoveContainer" containerID="694c597b371f40a4009aa1f3869f48ed6483955b0e4fd317fe60c249424e7a42"
Oct 31 00:50:30.134652 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:30.134621    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"]
Oct 31 00:50:30.183101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:30.183068    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-f32ec2-f9466fbb7-4m8d7"]
Oct 31 00:50:30.453348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:30.453317    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ce6a928-8cd0-4ea5-a132-b3d90de6309a" path="/var/lib/kubelet/pods/2ce6a928-8cd0-4ea5-a132-b3d90de6309a/volumes"
Oct 31 00:50:46.545493 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:50:46.545449    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:50:51.273131 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.273085    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"]
Oct 31 00:50:51.273939 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.273902    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" podUID="3d51ef82-4055-47e6-9aec-69fdb0b6972d" containerName="maas-api" containerID="cri-o://caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c" gracePeriod=30
Oct 31 00:50:51.704599 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.704571    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:50:51.869639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.869605    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca\") pod \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") "
Oct 31 00:50:51.869843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.869671    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt\" (UniqueName: \"kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt\") pod \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") "
Oct 31 00:50:51.869843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.869750    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs\") pod \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") "
Oct 31 00:50:51.869843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.869778    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\") pod \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\" (UID: \"3d51ef82-4055-47e6-9aec-69fdb0b6972d\") "
Oct 31 00:50:51.870474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.870401    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca" pod "3d51ef82-4055-47e6-9aec-69fdb0b6972d" (UID: "3d51ef82-4055-47e6-9aec-69fdb0b6972d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:50:51.874300 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.874271    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs" pod "3d51ef82-4055-47e6-9aec-69fdb0b6972d" (UID: "3d51ef82-4055-47e6-9aec-69fdb0b6972d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:50:51.874605 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.874540    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls" pod "3d51ef82-4055-47e6-9aec-69fdb0b6972d" (UID: "3d51ef82-4055-47e6-9aec-69fdb0b6972d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:50:51.874711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.874605    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt" pod "3d51ef82-4055-47e6-9aec-69fdb0b6972d" (UID: "3d51ef82-4055-47e6-9aec-69fdb0b6972d"). InnerVolumeSpecName "kube-api-access-n4mrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:50:51.979074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.978832    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4mrt\" (UniqueName: \"kubernetes.io/projected/3d51ef82-4055-47e6-9aec-69fdb0b6972d-kube-api-access-n4mrt\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:51.979074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.978875    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:51.979074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.978891    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d51ef82-4055-47e6-9aec-69fdb0b6972d-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:51.979074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:51.978906    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d51ef82-4055-47e6-9aec-69fdb0b6972d-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:50:52.183607 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.183575    5925 generic.go:356] "Generic (PLEG): container finished" podID="3d51ef82-4055-47e6-9aec-69fdb0b6972d" containerID="caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c" exitCode=0
Oct 31 00:50:52.183769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.183624    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"
Oct 31 00:50:52.183769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.183659    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" event={"ID":"3d51ef82-4055-47e6-9aec-69fdb0b6972d","Type":"ContainerDied","Data":"caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c"}
Oct 31 00:50:52.183769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.183712    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv" event={"ID":"3d51ef82-4055-47e6-9aec-69fdb0b6972d","Type":"ContainerDied","Data":"6be64c5b4b8749f6f575904b3cc5b4b694c977668bf7236808813ec4fe166f65"}
Oct 31 00:50:52.183769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.183734    5925 scope.go:122] "RemoveContainer" containerID="caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c"
Oct 31 00:50:52.195453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.195433    5925 scope.go:122] "RemoveContainer" containerID="caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c"
Oct 31 00:50:52.195721 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:50:52.195696    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c\": container with ID starting with caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c not found: ID does not exist" containerID="caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c"
Oct 31 00:50:52.195769 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.195729    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c"} err="failed to get container status \"caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c\": rpc error: code = NotFound desc = could not find container \"caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c\": container with ID starting with caa08fbe3a31415b847c4d0af1360ee8f2753a459576d4cda69ae47cb0a0ac7c not found: ID does not exist"
Oct 31 00:50:52.344631 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.344596    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"]
Oct 31 00:50:52.414437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.413075    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w6-e030e0-56c6665485-cltmv"]
Oct 31 00:50:52.454739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:50:52.454703    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3d51ef82-4055-47e6-9aec-69fdb0b6972d" path="/var/lib/kubelet/pods/3d51ef82-4055-47e6-9aec-69fdb0b6972d/volumes"
Oct 31 00:51:03.752740 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.752698    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"]
Oct 31 00:51:03.753495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753474    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ce430cb0-8433-45bc-aa63-7d1b704ec7d7" containerName="maas-api"
Oct 31 00:51:03.753495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753495    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce430cb0-8433-45bc-aa63-7d1b704ec7d7" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753511    5925 cpu_manager.go:414] "containerMap: removing container" podUID="2ce6a928-8cd0-4ea5-a132-b3d90de6309a" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753516    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ce6a928-8cd0-4ea5-a132-b3d90de6309a" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753531    5925 cpu_manager.go:414] "containerMap: removing container" podUID="c9885498-ddf0-499e-b943-6ada0b147c8f" containerName="payload-pre-processing"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753536    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c9885498-ddf0-499e-b943-6ada0b147c8f" containerName="payload-pre-processing"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753543    5925 cpu_manager.go:414] "containerMap: removing container" podUID="b50ac5dd-d6b2-4f72-9f75-4984185fc93c" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753548    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b50ac5dd-d6b2-4f72-9f75-4984185fc93c" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753567    5925 cpu_manager.go:414] "containerMap: removing container" podUID="3d51ef82-4055-47e6-9aec-69fdb0b6972d" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753572    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3d51ef82-4055-47e6-9aec-69fdb0b6972d" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753582    5925 cpu_manager.go:414] "containerMap: removing container" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753587    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753595    5925 cpu_manager.go:414] "containerMap: removing container" podUID="d8efb4c2-24e5-4d83-acdf-d37afe991f27" containerName="maas-api"
Oct 31 00:51:03.753612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753600    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8efb4c2-24e5-4d83-acdf-d37afe991f27" containerName="maas-api"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753697    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce430cb0-8433-45bc-aa63-7d1b704ec7d7" containerName="maas-api"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753708    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ce6a928-8cd0-4ea5-a132-b3d90de6309a" containerName="maas-api"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753714    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="c9885498-ddf0-499e-b943-6ada0b147c8f" containerName="payload-pre-processing"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753722    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="b50ac5dd-d6b2-4f72-9f75-4984185fc93c" containerName="maas-api"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753730    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="3d51ef82-4055-47e6-9aec-69fdb0b6972d" containerName="maas-api"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753737    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="27401dfd-ad05-4055-8e63-6445894bc55b" containerName="main"
Oct 31 00:51:03.754356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.753742    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8efb4c2-24e5-4d83-acdf-d37afe991f27" containerName="maas-api"
Oct 31 00:51:03.759150 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.759129    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.838307 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.838273    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.838506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.838466    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.838599 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.838523    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.838599 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.838593    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzwmq\" (UniqueName: \"kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.858826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.858797    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7d5f4de7-serving-cert\""
Oct 31 00:51:03.864535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.864508    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"]
Oct 31 00:51:03.939298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.939266    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.939484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.939327    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.939484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.939359    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzwmq\" (UniqueName: \"kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.939484 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.939409    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.939484 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:03.939454    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-serving-cert: secret "maas-api-e2e-mt-7d5f4de7-serving-cert" not found
Oct 31 00:51:03.939716 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:03.939555    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls podName:59202309-1f40-4f2d-8ea3-04a6995153a9 nodeName:}" failed. No retries permitted until 2026-10-31 00:51:04.439531886 +0000 UTC m=+2166.128411812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls") pod "maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" (UID: "59202309-1f40-4f2d-8ea3-04a6995153a9") : secret "maas-api-e2e-mt-7d5f4de7-serving-cert" not found
Oct 31 00:51:03.940068 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.940049    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.942149 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.942119    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:03.998477 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:03.998443    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzwmq\" (UniqueName: \"kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:04.454234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:04.454191    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:04.456676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:04.456644    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\") pod \"maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:04.672398 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:04.672360    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:05.063639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:05.063512    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"]
Oct 31 00:51:05.068853 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:51:05.068826    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59202309_1f40_4f2d_8ea3_04a6995153a9.slice/crio-c3da7812ab944d04338dd9da7782f695143edeb90f56aacfaa09f5e038fc35fc WatchSource:0}: Error finding container c3da7812ab944d04338dd9da7782f695143edeb90f56aacfaa09f5e038fc35fc: Status 404 returned error can't find the container with id c3da7812ab944d04338dd9da7782f695143edeb90f56aacfaa09f5e038fc35fc
Oct 31 00:51:05.295388 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:05.295352    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" event={"ID":"59202309-1f40-4f2d-8ea3-04a6995153a9","Type":"ContainerStarted","Data":"c3da7812ab944d04338dd9da7782f695143edeb90f56aacfaa09f5e038fc35fc"}
Oct 31 00:51:06.304242 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:06.304147    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" event={"ID":"59202309-1f40-4f2d-8ea3-04a6995153a9","Type":"ContainerStarted","Data":"af3879b407804ca778260fdd9980f5fc49e4a20fb0db272fe34ce65fb7c9c2c7"}
Oct 31 00:51:06.304242 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:06.304209    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:06.420399 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:06.420219    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" podStartSLOduration=2.593761163 podStartE2EDuration="3.420201779s" totalImagesPullingTime="826.440616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:06.417153634 +0000 UTC m=+2168.106033580" watchObservedRunningTime="2026-10-31 00:51:06.420201779 +0000 UTC m=+2168.109081725"
Oct 31 00:51:08.658559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:08.658522    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"]
Oct 31 00:51:08.659039 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:08.658798    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld" podUID="ebfeee73-d078-4074-80e3-3dd2680300e9" containerName="maas-api" containerID="cri-o://44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b" gracePeriod=30
Oct 31 00:51:08.953730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:08.953701    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:51:09.120750 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.120712    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca\") pod \"ebfeee73-d078-4074-80e3-3dd2680300e9\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") "
Oct 31 00:51:09.120947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.120827    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs\") pod \"ebfeee73-d078-4074-80e3-3dd2680300e9\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") "
Oct 31 00:51:09.121063 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.121040    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs\" (UniqueName: \"kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs\") pod \"ebfeee73-d078-4074-80e3-3dd2680300e9\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") "
Oct 31 00:51:09.121160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.121083    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls\") pod \"ebfeee73-d078-4074-80e3-3dd2680300e9\" (UID: \"ebfeee73-d078-4074-80e3-3dd2680300e9\") "
Oct 31 00:51:09.121219 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.121162    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca" pod "ebfeee73-d078-4074-80e3-3dd2680300e9" (UID: "ebfeee73-d078-4074-80e3-3dd2680300e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:51:09.121814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.121789    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebfeee73-d078-4074-80e3-3dd2680300e9-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:09.123361 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.123336    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs" pod "ebfeee73-d078-4074-80e3-3dd2680300e9" (UID: "ebfeee73-d078-4074-80e3-3dd2680300e9"). InnerVolumeSpecName "kube-api-access-pgpfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:51:09.123507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.123401    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs" pod "ebfeee73-d078-4074-80e3-3dd2680300e9" (UID: "ebfeee73-d078-4074-80e3-3dd2680300e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:51:09.123639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.123617    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls" pod "ebfeee73-d078-4074-80e3-3dd2680300e9" (UID: "ebfeee73-d078-4074-80e3-3dd2680300e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:51:09.223810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.223734    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:09.223810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.223766    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgpfs\" (UniqueName: \"kubernetes.io/projected/ebfeee73-d078-4074-80e3-3dd2680300e9-kube-api-access-pgpfs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:09.223810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.223776    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebfeee73-d078-4074-80e3-3dd2680300e9-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:09.331595 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.331557    5925 generic.go:356] "Generic (PLEG): container finished" podID="ebfeee73-d078-4074-80e3-3dd2680300e9" containerID="44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b" exitCode=0
Oct 31 00:51:09.331788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.331609    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"
Oct 31 00:51:09.331788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.331655    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld" event={"ID":"ebfeee73-d078-4074-80e3-3dd2680300e9","Type":"ContainerDied","Data":"44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b"}
Oct 31 00:51:09.331788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.331715    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld" event={"ID":"ebfeee73-d078-4074-80e3-3dd2680300e9","Type":"ContainerDied","Data":"0779d27b76b7cdfbc177b63b1a45bb6011b5ace2bd9eb125a3273dffcecc0143"}
Oct 31 00:51:09.331788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.331745    5925 scope.go:122] "RemoveContainer" containerID="44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b"
Oct 31 00:51:09.344326 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.344305    5925 scope.go:122] "RemoveContainer" containerID="44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b"
Oct 31 00:51:09.344624 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:09.344598    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b\": container with ID starting with 44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b not found: ID does not exist" containerID="44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b"
Oct 31 00:51:09.344749 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.344634    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b"} err="failed to get container status \"44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b\": rpc error: code = NotFound desc = could not find container \"44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b\": container with ID starting with 44a630866ed2e08d4267180b9b83158944b338a6e6913e50d26cd8ad3a93d95b not found: ID does not exist"
Oct 31 00:51:09.490949 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.490844    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"]
Oct 31 00:51:09.494644 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:09.494615    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-dcdbd0-5ddf7bc78d-fhgld"]
Oct 31 00:51:10.405219 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.405183    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"]
Oct 31 00:51:10.406023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.406003    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ebfeee73-d078-4074-80e3-3dd2680300e9" containerName="maas-api"
Oct 31 00:51:10.406023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.406022    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ebfeee73-d078-4074-80e3-3dd2680300e9" containerName="maas-api"
Oct 31 00:51:10.406203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.406191    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ebfeee73-d078-4074-80e3-3dd2680300e9" containerName="maas-api"
Oct 31 00:51:10.411248 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.411228    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.453276 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.453249    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ebfeee73-d078-4074-80e3-3dd2680300e9" path="/var/lib/kubelet/pods/ebfeee73-d078-4074-80e3-3dd2680300e9/volumes"
Oct 31 00:51:10.466003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.465973    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4ab8e5-serving-cert\""
Oct 31 00:51:10.473111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.473084    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"]
Oct 31 00:51:10.540181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.540119    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.540395 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.540283    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.540395 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.540326    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.540541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.540510    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b45pk\" (UniqueName: \"kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.641888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.641852    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.642057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.641910    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.642057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.641950    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.642057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.642035    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b45pk\" (UniqueName: \"kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.642232 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:10.642094    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-serving-cert: secret "maas-api-e2e-inf-a-4ab8e5-serving-cert" not found
Oct 31 00:51:10.642439 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:10.642394    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls podName:9ff5d215-17c9-42b7-9c9b-d3de426a3464 nodeName:}" failed. No retries permitted until 2026-10-31 00:51:11.1423711 +0000 UTC m=+2172.831251031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls") pod "maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" (UID: "9ff5d215-17c9-42b7-9c9b-d3de426a3464") : secret "maas-api-e2e-inf-a-4ab8e5-serving-cert" not found
Oct 31 00:51:10.642797 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.642773    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.645131 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.645104    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:10.708056 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:10.707982    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b45pk\" (UniqueName: \"kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:11.149101 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:11.149063    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:11.153275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:11.153250    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:11.327481 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:11.327399    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:11.713524 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:11.713482    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"]
Oct 31 00:51:11.720007 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:51:11.719968    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff5d215_17c9_42b7_9c9b_d3de426a3464.slice/crio-a7171210e8023cc7e5c91bae02456bbd5d2225e1b19121edf779f7673af7ca63 WatchSource:0}: Error finding container a7171210e8023cc7e5c91bae02456bbd5d2225e1b19121edf779f7673af7ca63: Status 404 returned error can't find the container with id a7171210e8023cc7e5c91bae02456bbd5d2225e1b19121edf779f7673af7ca63
Oct 31 00:51:12.318498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:12.318467    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:51:12.360143 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:12.360100    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" event={"ID":"9ff5d215-17c9-42b7-9c9b-d3de426a3464","Type":"ContainerStarted","Data":"a7171210e8023cc7e5c91bae02456bbd5d2225e1b19121edf779f7673af7ca63"}
Oct 31 00:51:13.368983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:13.368939    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" event={"ID":"9ff5d215-17c9-42b7-9c9b-d3de426a3464","Type":"ContainerStarted","Data":"69d740474abe19b71ebc7e40ae612f04bfd484a8a4561e950da25e1fac186f34"}
Oct 31 00:51:13.369453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:13.369174    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:13.486291 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:13.486235    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" podStartSLOduration=2.624576731 podStartE2EDuration="3.486220011s" totalImagesPullingTime="861.64328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:13.484952818 +0000 UTC m=+2175.173832766" watchObservedRunningTime="2026-10-31 00:51:13.486220011 +0000 UTC m=+2175.175100010"
Oct 31 00:51:16.545456 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:16.545395    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:51:19.382923 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:19.382889    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:51:24.562960 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:24.562920    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"]
Oct 31 00:51:35.007579 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:35.007539    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"]
Oct 31 00:51:35.008264 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:35.007836    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy" containerID="cri-o://faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e" gracePeriod=30
Oct 31 00:51:39.588906 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.588840    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main" containerID="cri-o://5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680" gracePeriod=45
Oct 31 00:51:39.870651 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.870621    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:51:39.911596 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.911559    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm\") pod \"09160224-0dc7-45f8-aab6-a9a3778870ee\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") "
Oct 31 00:51:39.911790 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.911629    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz\" (UniqueName: \"kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz\") pod \"09160224-0dc7-45f8-aab6-a9a3778870ee\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") "
Oct 31 00:51:39.911790 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.911785    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home\") pod \"09160224-0dc7-45f8-aab6-a9a3778870ee\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") "
Oct 31 00:51:39.911978 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.911841    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs\" (UniqueName: \"kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs\") pod \"09160224-0dc7-45f8-aab6-a9a3778870ee\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") "
Oct 31 00:51:39.911978 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.911871    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir\") pod \"09160224-0dc7-45f8-aab6-a9a3778870ee\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") "
Oct 31 00:51:39.911978 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.911905    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache\") pod \"09160224-0dc7-45f8-aab6-a9a3778870ee\" (UID: \"09160224-0dc7-45f8-aab6-a9a3778870ee\") "
Oct 31 00:51:39.912143 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.912065    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home" pod "09160224-0dc7-45f8-aab6-a9a3778870ee" (UID: "09160224-0dc7-45f8-aab6-a9a3778870ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:39.912143 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.912094    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir" pod "09160224-0dc7-45f8-aab6-a9a3778870ee" (UID: "09160224-0dc7-45f8-aab6-a9a3778870ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:39.912299 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.912240    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache" pod "09160224-0dc7-45f8-aab6-a9a3778870ee" (UID: "09160224-0dc7-45f8-aab6-a9a3778870ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:39.912716 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.912694    5925 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-home\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:39.912716 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.912716    5925 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-tmp-dir\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:39.912860 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.912725    5925 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-model-cache\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:39.913871 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.913843    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm" pod "09160224-0dc7-45f8-aab6-a9a3778870ee" (UID: "09160224-0dc7-45f8-aab6-a9a3778870ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:39.913958 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.913885    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs" pod "09160224-0dc7-45f8-aab6-a9a3778870ee" (UID: "09160224-0dc7-45f8-aab6-a9a3778870ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:51:39.913958 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:39.913924    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz" pod "09160224-0dc7-45f8-aab6-a9a3778870ee" (UID: "09160224-0dc7-45f8-aab6-a9a3778870ee"). InnerVolumeSpecName "kube-api-access-chgmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:51:40.014312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.014277    5925 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09160224-0dc7-45f8-aab6-a9a3778870ee-tls-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.014312 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.014313    5925 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09160224-0dc7-45f8-aab6-a9a3778870ee-dshm\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.014581 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.014328    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chgmz\" (UniqueName: \"kubernetes.io/projected/09160224-0dc7-45f8-aab6-a9a3778870ee-kube-api-access-chgmz\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.308777 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.308744    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:51:40.318960 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.318934    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319118 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.318975    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319118 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319021    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319118 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319085    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319136    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319210    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319246    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:40.319308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319265    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319530 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319408    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319530 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319477    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo\") pod \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\" (UID: \"63edbbb4-ebe7-4e1e-add9-9689b2bb365e\") "
Oct 31 00:51:40.319530 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319499    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:40.319530 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319514    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:40.319748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319735    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:40.319887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.319862    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:51:40.320248 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.320222    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.320346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.320252    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.320346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.320269    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.320346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.320285    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.320346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.320300    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.321514 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.321467    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:51:40.321620 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.321591    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:51:40.321669 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.321612    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "kube-api-access-zsb2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:51:40.321852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.321828    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo" pod "63edbbb4-ebe7-4e1e-add9-9689b2bb365e" (UID: "63edbbb4-ebe7-4e1e-add9-9689b2bb365e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:51:40.421933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.421837    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsb2g\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-kube-api-access-zsb2g\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.421933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.421874    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.421933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.421885    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.421933 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.421893    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63edbbb4-ebe7-4e1e-add9-9689b2bb365e-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:40.643833 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.643780    5925 generic.go:356] "Generic (PLEG): container finished" podID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerID="5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680" exitCode=0
Oct 31 00:51:40.644301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.643838    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"
Oct 31 00:51:40.644301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.643858    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" event={"ID":"09160224-0dc7-45f8-aab6-a9a3778870ee","Type":"ContainerDied","Data":"5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680"}
Oct 31 00:51:40.644301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.643912    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd" event={"ID":"09160224-0dc7-45f8-aab6-a9a3778870ee","Type":"ContainerDied","Data":"1c3d94086738085883b089ce9c3d84a4c4588b628b1cbeff46800b075caef239"}
Oct 31 00:51:40.644301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.643936    5925 scope.go:122] "RemoveContainer" containerID="5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680"
Oct 31 00:51:40.646736 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.646710    5925 generic.go:356] "Generic (PLEG): container finished" podID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerID="faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e" exitCode=0
Oct 31 00:51:40.646841 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.646790    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" event={"ID":"63edbbb4-ebe7-4e1e-add9-9689b2bb365e","Type":"ContainerDied","Data":"faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e"}
Oct 31 00:51:40.646881 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.646862    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf" event={"ID":"63edbbb4-ebe7-4e1e-add9-9689b2bb365e","Type":"ContainerDied","Data":"bae664f6e3fe7d9be07ae9cc78d83ff669ab184e040c45ebdef7abd4534c3349"}
Oct 31 00:51:40.646977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.646962    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"
Oct 31 00:51:40.655383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.655366    5925 scope.go:122] "RemoveContainer" containerID="5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680"
Oct 31 00:51:40.655731 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:40.655711    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680\": container with ID starting with 5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680 not found: ID does not exist" containerID="5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680"
Oct 31 00:51:40.655810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.655741    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680"} err="failed to get container status \"5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680\": rpc error: code = NotFound desc = could not find container \"5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680\": container with ID starting with 5d8a0a73a1f3d8e1564df927e00f64cd6c5f34211f1f19051bfe3bbadf715680 not found: ID does not exist"
Oct 31 00:51:40.655810 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.655759    5925 scope.go:122] "RemoveContainer" containerID="faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e"
Oct 31 00:51:40.667354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.667333    5925 scope.go:122] "RemoveContainer" containerID="fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"
Oct 31 00:51:40.677429 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.677396    5925 scope.go:122] "RemoveContainer" containerID="faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e"
Oct 31 00:51:40.677793 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:40.677767    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e\": container with ID starting with faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e not found: ID does not exist" containerID="faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e"
Oct 31 00:51:40.677890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.677805    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e"} err="failed to get container status \"faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e\": rpc error: code = NotFound desc = could not find container \"faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e\": container with ID starting with faa936805d2980e81ac8ece0e8b65b9157408622dcf82b4eba96eb4d608f0a7e not found: ID does not exist"
Oct 31 00:51:40.677890 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.677825    5925 scope.go:122] "RemoveContainer" containerID="fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"
Oct 31 00:51:40.678613 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:40.678251    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8\": container with ID starting with fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8 not found: ID does not exist" containerID="fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"
Oct 31 00:51:40.678613 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.678295    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8"} err="failed to get container status \"fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8\": rpc error: code = NotFound desc = could not find container \"fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8\": container with ID starting with fe49eb2e7e4be943c4a28f7be3566ba4b9ca44b6a29121192070d811a4e39af8 not found: ID does not exist"
Oct 31 00:51:40.804166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.804127    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"]
Oct 31 00:51:40.853179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.853136    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-da9d07-openshift-default-798d9948bc-tl6qf"]
Oct 31 00:51:40.912402 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.912369    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"]
Oct 31 00:51:40.916376 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:40.916349    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-e8ba06/distinct-w2-e8ba06-kserve-57795b7bc7-sgpwd"]
Oct 31 00:51:42.457120 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:42.457075    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" path="/var/lib/kubelet/pods/09160224-0dc7-45f8-aab6-a9a3778870ee/volumes"
Oct 31 00:51:42.457660 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:42.457643    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" path="/var/lib/kubelet/pods/63edbbb4-ebe7-4e1e-add9-9689b2bb365e/volumes"
Oct 31 00:51:46.544645 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:51:46.544605    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:51:53.579535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.579499    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"]
Oct 31 00:51:53.580404 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580380    5925 cpu_manager.go:414] "containerMap: removing container" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy"
Oct 31 00:51:53.580480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580407    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy"
Oct 31 00:51:53.580480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580478    5925 cpu_manager.go:414] "containerMap: removing container" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main"
Oct 31 00:51:53.580546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580486    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main"
Oct 31 00:51:53.580546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580507    5925 cpu_manager.go:414] "containerMap: removing container" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy"
Oct 31 00:51:53.580546 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580514    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy"
Oct 31 00:51:53.580684 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580671    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="09160224-0dc7-45f8-aab6-a9a3778870ee" containerName="main"
Oct 31 00:51:53.580720 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.580691    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy"
Oct 31 00:51:53.584636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.584615    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.634691 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.634648    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7d5f4de7-openshift-default-dockercfg-q5jrh\""
Oct 31 00:51:53.716031 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.715991    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716218 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716045    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716218 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716133    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716218 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716194    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716300    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716444 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716397    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716449    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716494    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9sv\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.716569 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.716557    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.786113 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.786079    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"]
Oct 31 00:51:53.817883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.817842    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.817894    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.817944    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818014    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818269 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818108    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818269 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818132    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818269 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818201    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9sv\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818269 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818243    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818587 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818319    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818587 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818400    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818772 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818735    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.818942 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.818912    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.819290 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.819264    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.819388 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.819294    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.821174 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.821130    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.821656 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.821635    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.877001 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.876961    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.877157 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.877016    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9sv\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:53.901039 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:53.901008    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:54.349555 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.349518    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"]
Oct 31 00:51:54.354223 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:51:54.354193    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a77f69_6b1d_4fbf_860e_c3dfa8455e2f.slice/crio-349f949d077fd160bf31316bd1facb6c8cf4195702a5f2e3b9cc3a5770f640a3 WatchSource:0}: Error finding container 349f949d077fd160bf31316bd1facb6c8cf4195702a5f2e3b9cc3a5770f640a3: Status 404 returned error can't find the container with id 349f949d077fd160bf31316bd1facb6c8cf4195702a5f2e3b9cc3a5770f640a3
Oct 31 00:51:54.356775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.356743    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:51:54.356867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.356810    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:51:54.356867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.356840    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:51:54.752365 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.752279    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" event={"ID":"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f","Type":"ContainerStarted","Data":"9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc"}
Oct 31 00:51:54.752764 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.752378    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" event={"ID":"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f","Type":"ContainerStarted","Data":"349f949d077fd160bf31316bd1facb6c8cf4195702a5f2e3b9cc3a5770f640a3"}
Oct 31 00:51:54.901376 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.901335    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:51:54.966013 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:54.965957    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podStartSLOduration=1.9659408969999999 podStartE2EDuration="1.965940897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:51:54.914991211 +0000 UTC m=+2216.603871156" watchObservedRunningTime="2026-10-31 00:51:54.965940897 +0000 UTC m=+2216.654820940"
Oct 31 00:51:55.902972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:55.902936    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 31 00:51:55.903349 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:55.902990    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 31 00:51:56.901761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:56.901718    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 31 00:51:56.901990 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:56.901775    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 31 00:51:57.329521 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.329316    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"]
Oct 31 00:51:57.329963 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.329562    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" podUID="37c94c6a-9d05-44e5-889d-7600c5a98bf1" containerName="maas-api" containerID="cri-o://9b547fd4c71c547a7ea4a0be892accc535dbc2693cdff7090305e87d955aa8b1" gracePeriod=30
Oct 31 00:51:57.789086 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.789047    5925 generic.go:356] "Generic (PLEG): container finished" podID="37c94c6a-9d05-44e5-889d-7600c5a98bf1" containerID="9b547fd4c71c547a7ea4a0be892accc535dbc2693cdff7090305e87d955aa8b1" exitCode=0
Oct 31 00:51:57.789241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.789215    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" event={"ID":"37c94c6a-9d05-44e5-889d-7600c5a98bf1","Type":"ContainerDied","Data":"9b547fd4c71c547a7ea4a0be892accc535dbc2693cdff7090305e87d955aa8b1"}
Oct 31 00:51:57.810042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.810012    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:51:57.906680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.906537    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 31 00:51:57.906680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.906602    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 31 00:51:57.994603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.994510    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca\") pod \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") "
Oct 31 00:51:57.994793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.994625    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8\" (UniqueName: \"kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8\") pod \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") "
Oct 31 00:51:57.994793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.994713    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs\") pod \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") "
Oct 31 00:51:57.994793 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.994775    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\") pod \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\" (UID: \"37c94c6a-9d05-44e5-889d-7600c5a98bf1\") "
Oct 31 00:51:57.996340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.996307    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca" pod "37c94c6a-9d05-44e5-889d-7600c5a98bf1" (UID: "37c94c6a-9d05-44e5-889d-7600c5a98bf1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:51:57.998731 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.998699    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs" pod "37c94c6a-9d05-44e5-889d-7600c5a98bf1" (UID: "37c94c6a-9d05-44e5-889d-7600c5a98bf1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:51:57.998862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.998838    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls" pod "37c94c6a-9d05-44e5-889d-7600c5a98bf1" (UID: "37c94c6a-9d05-44e5-889d-7600c5a98bf1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:51:57.998937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:57.998870    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8" pod "37c94c6a-9d05-44e5-889d-7600c5a98bf1" (UID: "37c94c6a-9d05-44e5-889d-7600c5a98bf1"). InnerVolumeSpecName "kube-api-access-q29j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:51:58.096176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.096143    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37c94c6a-9d05-44e5-889d-7600c5a98bf1-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:58.096176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.096171    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q29j8\" (UniqueName: \"kubernetes.io/projected/37c94c6a-9d05-44e5-889d-7600c5a98bf1-kube-api-access-q29j8\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:58.096176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.096184    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:58.096522 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.096193    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37c94c6a-9d05-44e5-889d-7600c5a98bf1-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:51:58.800643 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.800565    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"
Oct 31 00:51:58.801022 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.800561    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl" event={"ID":"37c94c6a-9d05-44e5-889d-7600c5a98bf1","Type":"ContainerDied","Data":"a64015eb55c925cd3f271e6053e6eb3c6da371c00744d8059cf339927938a8ea"}
Oct 31 00:51:58.801022 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.800717    5925 scope.go:122] "RemoveContainer" containerID="9b547fd4c71c547a7ea4a0be892accc535dbc2693cdff7090305e87d955aa8b1"
Oct 31 00:51:58.901972 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.901933    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 31 00:51:58.902123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.902022    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 31 00:51:58.973510 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:58.973478    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"]
Oct 31 00:51:59.007986 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:59.007945    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w0-e9c3c1-555d745c7c-m8qhl"]
Oct 31 00:51:59.902208 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:59.902168    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 31 00:51:59.902683 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:51:59.902224    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 31 00:52:00.456542 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:00.456495    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37c94c6a-9d05-44e5-889d-7600c5a98bf1" path="/var/lib/kubelet/pods/37c94c6a-9d05-44e5-889d-7600c5a98bf1/volumes"
Oct 31 00:52:00.943366 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:00.943324    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:52:00.944331 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:00.944304    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:52:00.945797 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:00.945468    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:52:03.581519 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.581484    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"]
Oct 31 00:52:03.582203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.582171    5925 cpu_manager.go:414] "containerMap: removing container" podUID="37c94c6a-9d05-44e5-889d-7600c5a98bf1" containerName="maas-api"
Oct 31 00:52:03.582203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.582191    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37c94c6a-9d05-44e5-889d-7600c5a98bf1" containerName="maas-api"
Oct 31 00:52:03.582460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.582382    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="63edbbb4-ebe7-4e1e-add9-9689b2bb365e" containerName="istio-proxy"
Oct 31 00:52:03.582460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.582401    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="37c94c6a-9d05-44e5-889d-7600c5a98bf1" containerName="maas-api"
Oct 31 00:52:03.588160 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.588140    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.639479 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.639447    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-e8ba06-openshift-default-dockercfg-97jbg\""
Oct 31 00:52:03.689343 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689280    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689343 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689345    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689633 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689469    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689633 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689567    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689633 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689606    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689675    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689702    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgzgl\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689751    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.689928 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.689852    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.692511 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.692478    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"]
Oct 31 00:52:03.790943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.790908    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.790943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.790945    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgzgl\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791200 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791086    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791259 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791225    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791294    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791303    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791345    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791432    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791552 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791513    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791600 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791552    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791659 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791633    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791820 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791796    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.791958 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.791935    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.792204 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.792183    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.793791 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.793765    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.793912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.793843    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.850126 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.850051    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.850277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.850251    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgzgl\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl\") pod \"e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") " pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:03.903048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:03.903013    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:04.347020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.346972    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"]
Oct 31 00:52:04.352601 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:52:04.352563    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c046db_5996_4ed9_bb09_d52ea6d80057.slice/crio-acd8c03b9b545faf59ba3b772f61770588c1aefe59336e1166ae46721bf85ef6 WatchSource:0}: Error finding container acd8c03b9b545faf59ba3b772f61770588c1aefe59336e1166ae46721bf85ef6: Status 404 returned error can't find the container with id acd8c03b9b545faf59ba3b772f61770588c1aefe59336e1166ae46721bf85ef6
Oct 31 00:52:04.355284 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.355245    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:04.355390 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.355336    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:04.355495 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.355409    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:04.902923 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.902884    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" event={"ID":"a2c046db-5996-4ed9-bb09-d52ea6d80057","Type":"ContainerStarted","Data":"e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805"}
Oct 31 00:52:04.903453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.902949    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" event={"ID":"a2c046db-5996-4ed9-bb09-d52ea6d80057","Type":"ContainerStarted","Data":"acd8c03b9b545faf59ba3b772f61770588c1aefe59336e1166ae46721bf85ef6"}
Oct 31 00:52:04.903453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:04.903055    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:05.024142 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:05.024022    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podStartSLOduration=2.0240018 podStartE2EDuration="2.0240018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:52:05.022053649 +0000 UTC m=+2226.710933638" watchObservedRunningTime="2026-10-31 00:52:05.0240018 +0000 UTC m=+2226.712881747"
Oct 31 00:52:05.905335 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:05.905297    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 31 00:52:05.905812 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:05.905395    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 31 00:52:06.903991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:06.903955    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 31 00:52:06.904286 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:06.904012    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 31 00:52:07.904194 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:07.904144    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 31 00:52:07.904641 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:07.904217    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 31 00:52:08.700215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.700175    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"]
Oct 31 00:52:08.706707 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.706683    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796094    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796141    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796185    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796240    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tsz9\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796259    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796304    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796333    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796368    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.796440 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.796391    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.836510 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.836468    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"]
Oct 31 00:52:08.897988 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.897950    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898005    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898076    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898168    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tsz9\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898195    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898299    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898468 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898351    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898468    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898481    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898582 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898522    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.898941 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898908    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.899067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.898941    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.899176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.899098    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.899176 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.899131    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.900821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.900797    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.901251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.901230    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.905508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.905479    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 31 00:52:08.905996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.905967    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 31 00:52:08.977265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.977186    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tsz9\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:08.979049 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:08.979012    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:09.024488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.024447    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:09.201457 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.201406    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"]
Oct 31 00:52:09.201717 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.201625    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" podUID="ede65313-a03b-477e-8cb2-3e101ca6c7ae" containerName="maas-api" containerID="cri-o://de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a" gracePeriod=30
Oct 31 00:52:09.521624 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.521588    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:09.521762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.521669    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:09.521762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.521717    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:09.524078 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.524046    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"]
Oct 31 00:52:09.703693 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.703664    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:52:09.832488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.831898    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz\" (UniqueName: \"kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz\") pod \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") "
Oct 31 00:52:09.832488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.832030    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca\") pod \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") "
Oct 31 00:52:09.832488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.832135    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs\") pod \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") "
Oct 31 00:52:09.832488 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.832224    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\") pod \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\" (UID: \"ede65313-a03b-477e-8cb2-3e101ca6c7ae\") "
Oct 31 00:52:09.832835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.832653    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca" pod "ede65313-a03b-477e-8cb2-3e101ca6c7ae" (UID: "ede65313-a03b-477e-8cb2-3e101ca6c7ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:52:09.836433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.832905    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ede65313-a03b-477e-8cb2-3e101ca6c7ae-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:09.836433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.835836    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs" pod "ede65313-a03b-477e-8cb2-3e101ca6c7ae" (UID: "ede65313-a03b-477e-8cb2-3e101ca6c7ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:52:09.836433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.835911    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls" pod "ede65313-a03b-477e-8cb2-3e101ca6c7ae" (UID: "ede65313-a03b-477e-8cb2-3e101ca6c7ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:52:09.836433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.836046    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz" pod "ede65313-a03b-477e-8cb2-3e101ca6c7ae" (UID: "ede65313-a03b-477e-8cb2-3e101ca6c7ae"). InnerVolumeSpecName "kube-api-access-kjthz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:09.905480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.904149    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 31 00:52:09.905480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.904217    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 31 00:52:09.934277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.934224    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjthz\" (UniqueName: \"kubernetes.io/projected/ede65313-a03b-477e-8cb2-3e101ca6c7ae-kube-api-access-kjthz\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:09.934277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.934257    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:09.934277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:09.934268    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ede65313-a03b-477e-8cb2-3e101ca6c7ae-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.013231    5925 generic.go:356] "Generic (PLEG): container finished" podID="ede65313-a03b-477e-8cb2-3e101ca6c7ae" containerID="de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a" exitCode=0
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.013346    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" event={"ID":"ede65313-a03b-477e-8cb2-3e101ca6c7ae","Type":"ContainerDied","Data":"de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a"}
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.013398    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6" event={"ID":"ede65313-a03b-477e-8cb2-3e101ca6c7ae","Type":"ContainerDied","Data":"0282e328fc1990c7483adc43d306c88f6bba233c5f777ee4cb48da1a1df34b7e"}
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.013447    5925 scope.go:122] "RemoveContainer" containerID="de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a"
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.013617    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.017239    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" event={"ID":"396874bf-c0a1-478b-9d1b-8e31e660a0d1","Type":"ContainerStarted","Data":"04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee"}
Oct 31 00:52:10.018313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.017295    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" event={"ID":"396874bf-c0a1-478b-9d1b-8e31e660a0d1","Type":"ContainerStarted","Data":"776a921e8ed0240e8473b9716c701628efc647f647d5f5cca1b5a6a497f3cd6c"}
Oct 31 00:52:10.025020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.024608    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:10.026123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.026099    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:10.026224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.026144    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:10.027826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.027809    5925 scope.go:122] "RemoveContainer" containerID="de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a"
Oct 31 00:52:10.028232 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:10.028176    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a\": container with ID starting with de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a not found: ID does not exist" containerID="de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a"
Oct 31 00:52:10.028232 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.028207    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a"} err="failed to get container status \"de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a\": rpc error: code = NotFound desc = could not find container \"de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a\": container with ID starting with de3372d5a5c9ce4f4d35f5d061dbef5c7553de4ace2a84b9500976ef5e080e0a not found: ID does not exist"
Oct 31 00:52:10.192006 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.191851    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podStartSLOduration=2.19183029 podStartE2EDuration="2.19183029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:52:10.186018407 +0000 UTC m=+2231.874898355" watchObservedRunningTime="2026-10-31 00:52:10.19183029 +0000 UTC m=+2231.880710239"
Oct 31 00:52:10.309439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.302625    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"]
Oct 31 00:52:10.320171 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.320085    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w6-2594a9-775c6c4665-mwzp6"]
Oct 31 00:52:10.466493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.466104    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ede65313-a03b-477e-8cb2-3e101ca6c7ae" path="/var/lib/kubelet/pods/ede65313-a03b-477e-8cb2-3e101ca6c7ae/volumes"
Oct 31 00:52:10.903739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.903701    5925 patch_prober.go:29] interesting pod/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 31 00:52:10.903935 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:10.903765    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 31 00:52:11.025193 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:11.025157    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:11.025661 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:11.025219    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:12.027977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:12.025883    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:12.027977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:12.025970    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:12.168043 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:12.168003    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:12.169650 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:12.169581    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:12.180289 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:12.180167    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:52:13.025783 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:13.025742    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:13.025979 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:13.025810    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:14.024937 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:14.024893    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:14.025359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:14.024966    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:15.025739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:15.025701    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:15.026148 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:15.025759    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:16.024847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:16.024804    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 31 00:52:16.025031 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:16.024867    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 31 00:52:16.579442 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:16.576661    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:52:17.192710 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:17.192671    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:17.193277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:17.193246    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:17.194408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:17.194387    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:52:23.829730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.829691    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"]
Oct 31 00:52:23.830548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.830527    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ede65313-a03b-477e-8cb2-3e101ca6c7ae" containerName="maas-api"
Oct 31 00:52:23.830548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.830547    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ede65313-a03b-477e-8cb2-3e101ca6c7ae" containerName="maas-api"
Oct 31 00:52:23.830691 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.830663    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ede65313-a03b-477e-8cb2-3e101ca6c7ae" containerName="maas-api"
Oct 31 00:52:23.834223 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.834204    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.922501 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.922455    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxhm\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.922855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.922833    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923051 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923033    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923180 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923166    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923279 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923265    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923398 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923377    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923563 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923546    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923676 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923663    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.923826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.923812    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:23.945674 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:23.945634    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"]
Oct 31 00:52:24.025221 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025171    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxhm\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025298    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025343    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025380    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025409    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025612 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025477    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025658    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025714    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025826 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025796    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.025884 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025854    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.026107 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.026076    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.026255 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.025987    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.026324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.026293    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.026376 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.026292    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.028048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.028027    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.028192 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.028174    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.084308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.084279    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxhm\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.084493 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.084278    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token\") pod \"e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") " pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.148954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.148920    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:24.613548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.613513    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"]
Oct 31 00:52:24.619672 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:52:24.619625    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb05242_7d96_400b_a491_2bf321c2d625.slice/crio-1b58e468dc32e3709a2f541f598340f720bdaca4cefba28228eca862a05ef12a WatchSource:0}: Error finding container 1b58e468dc32e3709a2f541f598340f720bdaca4cefba28228eca862a05ef12a: Status 404 returned error can't find the container with id 1b58e468dc32e3709a2f541f598340f720bdaca4cefba28228eca862a05ef12a
Oct 31 00:52:24.622280 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.622242    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:24.622376 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.622318    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:24.622376 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:24.622352    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:52:25.165976 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:25.165931    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" event={"ID":"4bb05242-7d96-400b-a491-2bf321c2d625","Type":"ContainerStarted","Data":"5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765"}
Oct 31 00:52:25.166461 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:25.166039    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" event={"ID":"4bb05242-7d96-400b-a491-2bf321c2d625","Type":"ContainerStarted","Data":"1b58e468dc32e3709a2f541f598340f720bdaca4cefba28228eca862a05ef12a"}
Oct 31 00:52:25.283283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:25.283222    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podStartSLOduration=2.283205508 podStartE2EDuration="2.283205508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:52:25.281163895 +0000 UTC m=+2246.970043841" watchObservedRunningTime="2026-10-31 00:52:25.283205508 +0000 UTC m=+2246.972085453"
Oct 31 00:52:26.160439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:26.154675    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:26.160439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:26.158543    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 31 00:52:26.160439 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:26.158609    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 31 00:52:27.070236 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.070087    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"]
Oct 31 00:52:27.070695 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.070358    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" podUID="53115e5a-28f7-4c96-b827-8092d92e5c4d" containerName="maas-api" containerID="cri-o://558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4" gracePeriod=30
Oct 31 00:52:27.186966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.186867    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 31 00:52:27.186966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.186925    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 31 00:52:27.633235 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.633208    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:52:27.720064 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.720034    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs\") pod \"53115e5a-28f7-4c96-b827-8092d92e5c4d\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") "
Oct 31 00:52:27.720267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.720138    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\") pod \"53115e5a-28f7-4c96-b827-8092d92e5c4d\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") "
Oct 31 00:52:27.720267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.720190    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca\") pod \"53115e5a-28f7-4c96-b827-8092d92e5c4d\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") "
Oct 31 00:52:27.720395 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.720279    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf\" (UniqueName: \"kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf\") pod \"53115e5a-28f7-4c96-b827-8092d92e5c4d\" (UID: \"53115e5a-28f7-4c96-b827-8092d92e5c4d\") "
Oct 31 00:52:27.720597 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.720564    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca" pod "53115e5a-28f7-4c96-b827-8092d92e5c4d" (UID: "53115e5a-28f7-4c96-b827-8092d92e5c4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:52:27.720911 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.720880    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53115e5a-28f7-4c96-b827-8092d92e5c4d-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:27.722340 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.722311    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs" pod "53115e5a-28f7-4c96-b827-8092d92e5c4d" (UID: "53115e5a-28f7-4c96-b827-8092d92e5c4d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:52:27.722459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.722335    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls" pod "53115e5a-28f7-4c96-b827-8092d92e5c4d" (UID: "53115e5a-28f7-4c96-b827-8092d92e5c4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:52:27.722459 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.722372    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf" pod "53115e5a-28f7-4c96-b827-8092d92e5c4d" (UID: "53115e5a-28f7-4c96-b827-8092d92e5c4d"). InnerVolumeSpecName "kube-api-access-b5lnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:27.822309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.822176    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5lnf\" (UniqueName: \"kubernetes.io/projected/53115e5a-28f7-4c96-b827-8092d92e5c4d-kube-api-access-b5lnf\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:27.822309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.822217    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:27.822309 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:27.822232    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53115e5a-28f7-4c96-b827-8092d92e5c4d-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:28.155433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.151068    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 31 00:52:28.155433 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.151133    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 31 00:52:28.228453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.225162    5925 generic.go:356] "Generic (PLEG): container finished" podID="53115e5a-28f7-4c96-b827-8092d92e5c4d" containerID="558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4" exitCode=0
Oct 31 00:52:28.228453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.225434    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" event={"ID":"53115e5a-28f7-4c96-b827-8092d92e5c4d","Type":"ContainerDied","Data":"558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4"}
Oct 31 00:52:28.228453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.225495    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5" event={"ID":"53115e5a-28f7-4c96-b827-8092d92e5c4d","Type":"ContainerDied","Data":"1fa69d59c18712435a789cfc35c423a6439972d0153391762cb53435e018eceb"}
Oct 31 00:52:28.228453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.225527    5925 scope.go:122] "RemoveContainer" containerID="558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4"
Oct 31 00:52:28.228453 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.225698    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"
Oct 31 00:52:28.292363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.285596    5925 scope.go:122] "RemoveContainer" containerID="558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4"
Oct 31 00:52:28.292363 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:28.287028    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4\": container with ID starting with 558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4 not found: ID does not exist" containerID="558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4"
Oct 31 00:52:28.292363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.287066    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4"} err="failed to get container status \"558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4\": rpc error: code = NotFound desc = could not find container \"558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4\": container with ID starting with 558437faed0b2951498f6910d8c2eae3118264112a482b29e055b33927ff99b4 not found: ID does not exist"
Oct 31 00:52:28.382802 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:28.382681    5925 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53115e5a_28f7_4c96_b827_8092d92e5c4d.slice/crio-1fa69d59c18712435a789cfc35c423a6439972d0153391762cb53435e018eceb\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53115e5a_28f7_4c96_b827_8092d92e5c4d.slice\": RecentStats: unable to find data in memory cache]"
Oct 31 00:52:28.397396 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.397326    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"]
Oct 31 00:52:28.400738 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.400683    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-982ae3-6774c57c44-qkzs5"]
Oct 31 00:52:28.494977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:28.494879    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53115e5a-28f7-4c96-b827-8092d92e5c4d" path="/var/lib/kubelet/pods/53115e5a-28f7-4c96-b827-8092d92e5c4d/volumes"
Oct 31 00:52:29.151852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:29.151814    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 31 00:52:29.152202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:29.152169    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 31 00:52:30.165308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:30.164871    5925 patch_prober.go:29] interesting pod/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 31 00:52:30.165308 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:30.164935    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 31 00:52:31.186020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:31.185983    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:31.186807 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:31.186773    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:31.188032 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:31.188007    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:52:36.939737 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:36.939658    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"]
Oct 31 00:52:36.940193 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:36.939924    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy" containerID="cri-o://d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca" gracePeriod=30
Oct 31 00:52:36.949901 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:36.949872    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"]
Oct 31 00:52:36.950204 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:36.950160    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" containerID="cri-o://370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f" gracePeriod=30
Oct 31 00:52:38.994886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:38.994840    5925 patch_prober.go:29] interesting pod/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:52:38.995362 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:38.994907    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:52:42.254634 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.254606    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:52:42.266242 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.266167    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:52:42.326827 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.326796    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.326861    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.326905    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.326928    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.326985    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327009    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327034    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327063    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327084    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327120    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327156    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327185    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.327207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327194    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327228    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327261    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327309    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327402    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327434    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327529    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327622    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs\") pod \"388f81f5-ea9c-467d-bf55-354776c49a1c\" (UID: \"388f81f5-ea9c-467d-bf55-354776c49a1c\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327630    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327652    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327702    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy\") pod \"6e94dd20-7028-473e-8033-42050f7395b4\" (UID: \"6e94dd20-7028-473e-8033-42050f7395b4\") "
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.327759    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328034    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328041    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328196    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328302    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328488    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e94dd20-7028-473e-8033-42050f7395b4-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328513    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328529    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328545    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328559    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328573    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328587    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328601    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328613    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.328614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.328626    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388f81f5-ea9c-467d-bf55-354776c49a1c-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.330073 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330035    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:52:42.330192 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330161    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "kube-api-access-fd5d8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:42.330405 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330381    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.330571 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330553    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:52:42.330775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330758    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:42.330854 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330787    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:42.330943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.330920    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo" pod "388f81f5-ea9c-467d-bf55-354776c49a1c" (UID: "388f81f5-ea9c-467d-bf55-354776c49a1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:52:42.331777 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.331756    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x" pod "6e94dd20-7028-473e-8033-42050f7395b4" (UID: "6e94dd20-7028-473e-8033-42050f7395b4"). InnerVolumeSpecName "kube-api-access-95m9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.436988    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437026    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95m9x\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-kube-api-access-95m9x\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437043    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e94dd20-7028-473e-8033-42050f7395b4-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437057    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e94dd20-7028-473e-8033-42050f7395b4-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437072    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437085    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e94dd20-7028-473e-8033-42050f7395b4-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437100    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd5d8\" (UniqueName: \"kubernetes.io/projected/388f81f5-ea9c-467d-bf55-354776c49a1c-kube-api-access-fd5d8\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.437140 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.437114    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388f81f5-ea9c-467d-bf55-354776c49a1c-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.440327    5925 generic.go:356] "Generic (PLEG): container finished" podID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerID="d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca" exitCode=0
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.440612    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" event={"ID":"388f81f5-ea9c-467d-bf55-354776c49a1c","Type":"ContainerDied","Data":"d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca"}
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.440682    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t" event={"ID":"388f81f5-ea9c-467d-bf55-354776c49a1c","Type":"ContainerDied","Data":"c40217ee37184b79781cc1fd47467003a051521c7fa464fba575b2eb8839cb3c"}
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.440718    5925 scope.go:122] "RemoveContainer" containerID="d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca"
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.440884    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.456139    5925 generic.go:356] "Generic (PLEG): container finished" podID="6e94dd20-7028-473e-8033-42050f7395b4" containerID="370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f" exitCode=0
Oct 31 00:52:42.457705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.456209    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"
Oct 31 00:52:42.471847 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.471815    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" event={"ID":"6e94dd20-7028-473e-8033-42050f7395b4","Type":"ContainerDied","Data":"370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f"}
Oct 31 00:52:42.472009 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.471855    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr" event={"ID":"6e94dd20-7028-473e-8033-42050f7395b4","Type":"ContainerDied","Data":"dec2365753865373b5372d2536258f40980fabd8a13692d83fd50489dbd8821b"}
Oct 31 00:52:42.478361 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.478344    5925 scope.go:122] "RemoveContainer" containerID="d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca"
Oct 31 00:52:42.478761 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:42.478741    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca\": container with ID starting with d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca not found: ID does not exist" containerID="d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca"
Oct 31 00:52:42.478864 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.478773    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca"} err="failed to get container status \"d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca\": rpc error: code = NotFound desc = could not find container \"d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca\": container with ID starting with d609d42a37370a6e07cf0c687eeafc7b5db72ee242e982b7f0065f48f7ad22ca not found: ID does not exist"
Oct 31 00:52:42.478864 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.478799    5925 scope.go:122] "RemoveContainer" containerID="370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f"
Oct 31 00:52:42.489739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.489711    5925 scope.go:122] "RemoveContainer" containerID="370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f"
Oct 31 00:52:42.490061 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:42.490042    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f\": container with ID starting with 370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f not found: ID does not exist" containerID="370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f"
Oct 31 00:52:42.490133 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.490070    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f"} err="failed to get container status \"370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f\": rpc error: code = NotFound desc = could not find container \"370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f\": container with ID starting with 370e8d0ac3af62df672fbba7c6919e6ea6d795b2bbc7d40783aa4d7a0e816c0f not found: ID does not exist"
Oct 31 00:52:42.618321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.618276    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"]
Oct 31 00:52:42.622390 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.622362    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-tlc4t"]
Oct 31 00:52:42.729892 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.729812    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"]
Oct 31 00:52:42.734903 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:42.734876    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-982ae3-openshift-default-64d9fb649f-l56vr"]
Oct 31 00:52:44.462438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:44.461805    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" path="/var/lib/kubelet/pods/388f81f5-ea9c-467d-bf55-354776c49a1c/volumes"
Oct 31 00:52:44.462976 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:44.462555    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6e94dd20-7028-473e-8033-42050f7395b4" path="/var/lib/kubelet/pods/6e94dd20-7028-473e-8033-42050f7395b4/volumes"
Oct 31 00:52:46.544309 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:52:46.544269    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:52:59.550999 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.550919    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"]
Oct 31 00:52:59.551606 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551589    5925 cpu_manager.go:414] "containerMap: removing container" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy"
Oct 31 00:52:59.551662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551608    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy"
Oct 31 00:52:59.551662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551627    5925 cpu_manager.go:414] "containerMap: removing container" podUID="53115e5a-28f7-4c96-b827-8092d92e5c4d" containerName="maas-api"
Oct 31 00:52:59.551662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551633    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53115e5a-28f7-4c96-b827-8092d92e5c4d" containerName="maas-api"
Oct 31 00:52:59.551662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551662    5925 cpu_manager.go:414] "containerMap: removing container" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy"
Oct 31 00:52:59.551784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551669    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy"
Oct 31 00:52:59.551784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551770    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="388f81f5-ea9c-467d-bf55-354776c49a1c" containerName="istio-proxy"
Oct 31 00:52:59.551784 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551782    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e94dd20-7028-473e-8033-42050f7395b4" containerName="istio-proxy"
Oct 31 00:52:59.551872 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.551789    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="53115e5a-28f7-4c96-b827-8092d92e5c4d" containerName="maas-api"
Oct 31 00:52:59.556788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.556767    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.595533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.595495    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.595670 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.595559    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.595751 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.595724    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.595814 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.595772    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.595877 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.595865    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.595954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.595937    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.596057 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.596032    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.596112 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.596075    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.596200 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.596178    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpbld\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.670076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.670041    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"]
Oct 31 00:52:59.682940 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.682877    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"]
Oct 31 00:52:59.683249 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.683193    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4" podUID="8c9e243d-6dac-4eda-9909-e9f17fe49aad" containerName="maas-api" containerID="cri-o://6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc" gracePeriod=30
Oct 31 00:52:59.697293 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697263    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697337    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697383 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697375    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697521 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697476    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpbld\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697598 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697574    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697708 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697628    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697714    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697780 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697752    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697790    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.697898 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.697807    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.698301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.698255    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.699486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.698638    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.699486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.698839    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.699486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.698909    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.701796 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.700895    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.710038 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.710006    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.757277 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.757232    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.757618 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.757594    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpbld\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld\") pod \"maas-default-gateway-openshift-default-6886b96f9-9nrmp\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:52:59.870639 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:52:59.870563    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:53:00.005384 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.005359    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:53:00.136875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.136383    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98\" (UniqueName: \"kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98\") pod \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") "
Oct 31 00:53:00.137281 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.137256    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs\") pod \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") "
Oct 31 00:53:00.137966 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.137944    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls\") pod \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") "
Oct 31 00:53:00.138136 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.138120    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca\") pod \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\" (UID: \"8c9e243d-6dac-4eda-9909-e9f17fe49aad\") "
Oct 31 00:53:00.139146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.139122    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca" pod "8c9e243d-6dac-4eda-9909-e9f17fe49aad" (UID: "8c9e243d-6dac-4eda-9909-e9f17fe49aad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:53:00.144477 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.144241    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98" pod "8c9e243d-6dac-4eda-9909-e9f17fe49aad" (UID: "8c9e243d-6dac-4eda-9909-e9f17fe49aad"). InnerVolumeSpecName "kube-api-access-5hn98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:00.144477 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.144386    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls" pod "8c9e243d-6dac-4eda-9909-e9f17fe49aad" (UID: "8c9e243d-6dac-4eda-9909-e9f17fe49aad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:53:00.145052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.145029    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs" pod "8c9e243d-6dac-4eda-9909-e9f17fe49aad" (UID: "8c9e243d-6dac-4eda-9909-e9f17fe49aad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:53:00.242886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.241792    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:00.242886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.241832    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c9e243d-6dac-4eda-9909-e9f17fe49aad-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:00.242886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.241849    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c9e243d-6dac-4eda-9909-e9f17fe49aad-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:00.242886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.241863    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hn98\" (UniqueName: \"kubernetes.io/projected/8c9e243d-6dac-4eda-9909-e9f17fe49aad-kube-api-access-5hn98\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:00.377610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.377566    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"]
Oct 31 00:53:00.382360 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:53:00.382330    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d77ab2e_c75c_4402_a128_0e068068f4c6.slice/crio-bdad2e2c61751325b0ecfb58b54a0cd137ed620a57b28e734b322799036d4ce0 WatchSource:0}: Error finding container bdad2e2c61751325b0ecfb58b54a0cd137ed620a57b28e734b322799036d4ce0: Status 404 returned error can't find the container with id bdad2e2c61751325b0ecfb58b54a0cd137ed620a57b28e734b322799036d4ce0
Oct 31 00:53:00.385042 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.385007    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:53:00.385123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.385074    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:53:00.385123 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.385102    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 00:53:00.698409 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.698315    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" event={"ID":"1d77ab2e-c75c-4402-a128-0e068068f4c6","Type":"ContainerStarted","Data":"0c79e6029bd2e9b6ca9ed57b44a03e11896140ed3a4c5a8d9eb4f0c07fb505fb"}
Oct 31 00:53:00.699075 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.699045    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" event={"ID":"1d77ab2e-c75c-4402-a128-0e068068f4c6","Type":"ContainerStarted","Data":"bdad2e2c61751325b0ecfb58b54a0cd137ed620a57b28e734b322799036d4ce0"}
Oct 31 00:53:00.703200 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.703171    5925 generic.go:356] "Generic (PLEG): container finished" podID="8c9e243d-6dac-4eda-9909-e9f17fe49aad" containerID="6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc" exitCode=0
Oct 31 00:53:00.704703 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.704675    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4" event={"ID":"8c9e243d-6dac-4eda-9909-e9f17fe49aad","Type":"ContainerDied","Data":"6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc"}
Oct 31 00:53:00.704886 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.704870    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4" event={"ID":"8c9e243d-6dac-4eda-9909-e9f17fe49aad","Type":"ContainerDied","Data":"32f10c70b34c6d331d8b53c75ed6c81e3e86f1334f44c96cbc55cdfddacc738c"}
Oct 31 00:53:00.705015 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.705003    5925 scope.go:122] "RemoveContainer" containerID="6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc"
Oct 31 00:53:00.705265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.705250    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"
Oct 31 00:53:00.775623 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.773588    5925 scope.go:122] "RemoveContainer" containerID="6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc"
Oct 31 00:53:00.778479 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:00.777742    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc\": container with ID starting with 6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc not found: ID does not exist" containerID="6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc"
Oct 31 00:53:00.778479 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.777799    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc"} err="failed to get container status \"6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc\": rpc error: code = NotFound desc = could not find container \"6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc\": container with ID starting with 6a8eb46b9c52ccd09da365624b0e5abff35da2ebb33380d43efc68d60474c1fc not found: ID does not exist"
Oct 31 00:53:00.842424 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.842370    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podStartSLOduration=1.84235591 podStartE2EDuration="1.84235591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:53:00.839161786 +0000 UTC m=+2282.528041771" watchObservedRunningTime="2026-10-31 00:53:00.84235591 +0000 UTC m=+2282.531235922"
Oct 31 00:53:00.871745 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.871709    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:53:00.958492 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.952102    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"]
Oct 31 00:53:00.958492 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:00.958014    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-5b4db8-7766b9bff6-c29q4"]
Oct 31 00:53:01.873031 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:01.872988    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:01.873487 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:01.873044    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:02.472265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:02.472221    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c9e243d-6dac-4eda-9909-e9f17fe49aad" path="/var/lib/kubelet/pods/8c9e243d-6dac-4eda-9909-e9f17fe49aad/volumes"
Oct 31 00:53:02.871944 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:02.871906    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:02.872144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:02.871966    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:03.871267 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:03.871227    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:03.871725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:03.871292    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:04.871324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:04.871290    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:04.871776 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:04.871343    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:05.871987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:05.871950    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:05.872475 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:05.872020    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:06.871537 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:06.871492    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:06.871734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:06.871566    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:07.871843 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:07.871787    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-9nrmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 31 00:53:07.872478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:07.871873    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 31 00:53:09.218207 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:09.218164    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"]
Oct 31 00:53:09.218697 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:09.218388    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy" containerID="cri-o://15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520" gracePeriod=30
Oct 31 00:53:09.249129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:09.249097    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:53:09.249588 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:09.249551    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:53:09.250500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:09.250481    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 00:53:11.468884 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.468842    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"]
Oct 31 00:53:11.469532 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.469106    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" podUID="59202309-1f40-4f2d-8ea3-04a6995153a9" containerName="maas-api" containerID="cri-o://af3879b407804ca778260fdd9980f5fc49e4a20fb0db272fe34ce65fb7c9c2c7" gracePeriod=30
Oct 31 00:53:11.796173 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.796141    5925 generic.go:356] "Generic (PLEG): container finished" podID="59202309-1f40-4f2d-8ea3-04a6995153a9" containerID="af3879b407804ca778260fdd9980f5fc49e4a20fb0db272fe34ce65fb7c9c2c7" exitCode=0
Oct 31 00:53:11.796328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.796204    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" event={"ID":"59202309-1f40-4f2d-8ea3-04a6995153a9","Type":"ContainerDied","Data":"af3879b407804ca778260fdd9980f5fc49e4a20fb0db272fe34ce65fb7c9c2c7"}
Oct 31 00:53:11.796328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.796243    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt" event={"ID":"59202309-1f40-4f2d-8ea3-04a6995153a9","Type":"ContainerDied","Data":"c3da7812ab944d04338dd9da7782f695143edeb90f56aacfaa09f5e038fc35fc"}
Oct 31 00:53:11.796328 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.796259    5925 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3da7812ab944d04338dd9da7782f695143edeb90f56aacfaa09f5e038fc35fc"
Oct 31 00:53:11.814304 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.814271    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:53:11.910910 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.910869    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca\") pod \"59202309-1f40-4f2d-8ea3-04a6995153a9\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") "
Oct 31 00:53:11.911324 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.911302    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq\" (UniqueName: \"kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq\") pod \"59202309-1f40-4f2d-8ea3-04a6995153a9\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") "
Oct 31 00:53:11.911541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.911523    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs\") pod \"59202309-1f40-4f2d-8ea3-04a6995153a9\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") "
Oct 31 00:53:11.912852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.912825    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\") pod \"59202309-1f40-4f2d-8ea3-04a6995153a9\" (UID: \"59202309-1f40-4f2d-8ea3-04a6995153a9\") "
Oct 31 00:53:11.913987 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.913945    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca" pod "59202309-1f40-4f2d-8ea3-04a6995153a9" (UID: "59202309-1f40-4f2d-8ea3-04a6995153a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:53:11.951480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.949727    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs" pod "59202309-1f40-4f2d-8ea3-04a6995153a9" (UID: "59202309-1f40-4f2d-8ea3-04a6995153a9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:53:11.951480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.949873    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls" pod "59202309-1f40-4f2d-8ea3-04a6995153a9" (UID: "59202309-1f40-4f2d-8ea3-04a6995153a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:53:11.951868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:11.951743    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq" pod "59202309-1f40-4f2d-8ea3-04a6995153a9" (UID: "59202309-1f40-4f2d-8ea3-04a6995153a9"). InnerVolumeSpecName "kube-api-access-gzwmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:12.014636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:12.014598    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59202309-1f40-4f2d-8ea3-04a6995153a9-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:12.014636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:12.014631    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzwmq\" (UniqueName: \"kubernetes.io/projected/59202309-1f40-4f2d-8ea3-04a6995153a9-kube-api-access-gzwmq\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:12.014636 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:12.014644    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:12.014875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:12.014652    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59202309-1f40-4f2d-8ea3-04a6995153a9-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:12.804166 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:12.804080    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"
Oct 31 00:53:12.962789 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:12.962742    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"]
Oct 31 00:53:13.010060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:13.010016    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7d5f4de7-7b48db8ff8-pj4dt"]
Oct 31 00:53:14.463283 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.463246    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59202309-1f40-4f2d-8ea3-04a6995153a9" path="/var/lib/kubelet/pods/59202309-1f40-4f2d-8ea3-04a6995153a9/volumes"
Oct 31 00:53:14.521139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.521113    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:53:14.569691 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.569656    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.569892 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.569766    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.569892 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.569846    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.569889    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.569932    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570015    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570052 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570043    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570050    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:53:14.570323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570150    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570323 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570196    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket\") pod \"3f901144-1cdf-4096-af9e-0494e5ad8402\" (UID: \"3f901144-1cdf-4096-af9e-0494e5ad8402\") "
Oct 31 00:53:14.570558 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570470    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:14.570700 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570680    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f901144-1cdf-4096-af9e-0494e5ad8402-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.570800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570700    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:14.570800 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570707    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.570929 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.570908    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:14.571516 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.571232    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:14.572779 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.572752    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "kube-api-access-2sz8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:14.573761 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.573734    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:53:14.573912 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.573891    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:14.574096 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.574078    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy" pod "3f901144-1cdf-4096-af9e-0494e5ad8402" (UID: "3f901144-1cdf-4096-af9e-0494e5ad8402"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:14.672474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672432    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.672474 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672473    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.672696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672488    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sz8p\" (UniqueName: \"kubernetes.io/projected/3f901144-1cdf-4096-af9e-0494e5ad8402-kube-api-access-2sz8p\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.672696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672502    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.672696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672516    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.672696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672531    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f901144-1cdf-4096-af9e-0494e5ad8402-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.672696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.672545    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f901144-1cdf-4096-af9e-0494e5ad8402-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:14.819408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.819320    5925 generic.go:356] "Generic (PLEG): container finished" podID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerID="15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520" exitCode=0
Oct 31 00:53:14.819408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.819369    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"
Oct 31 00:53:14.819408 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.819387    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" event={"ID":"3f901144-1cdf-4096-af9e-0494e5ad8402","Type":"ContainerDied","Data":"15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520"}
Oct 31 00:53:14.819680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.819443    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc" event={"ID":"3f901144-1cdf-4096-af9e-0494e5ad8402","Type":"ContainerDied","Data":"89e2593639950ea67db1f0d39c495af974f8b1ca49e1844c255e4f2746798969"}
Oct 31 00:53:14.819680 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.819465    5925 scope.go:122] "RemoveContainer" containerID="15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520"
Oct 31 00:53:14.831059 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.831037    5925 scope.go:122] "RemoveContainer" containerID="15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520"
Oct 31 00:53:14.831329 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:14.831311    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520\": container with ID starting with 15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520 not found: ID does not exist" containerID="15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520"
Oct 31 00:53:14.831373 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.831337    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520"} err="failed to get container status \"15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520\": rpc error: code = NotFound desc = could not find container \"15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520\": container with ID starting with 15ff0a28a2db623aced5f441be6b724ce854f2110e509cc4d056e3ff2eb76520 not found: ID does not exist"
Oct 31 00:53:14.980711 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.980656    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"]
Oct 31 00:53:14.985460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:14.985406    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5b4db8-openshift-default-5cc6998bbc-wqncc"]
Oct 31 00:53:16.458070 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:16.458024    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" path="/var/lib/kubelet/pods/3f901144-1cdf-4096-af9e-0494e5ad8402/volumes"
Oct 31 00:53:16.551406 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:16.551358    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:53:24.238955 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.238913    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"]
Oct 31 00:53:24.239895 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.239869    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8c9e243d-6dac-4eda-9909-e9f17fe49aad" containerName="maas-api"
Oct 31 00:53:24.239895 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.239894    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c9e243d-6dac-4eda-9909-e9f17fe49aad" containerName="maas-api"
Oct 31 00:53:24.240100 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.239920    5925 cpu_manager.go:414] "containerMap: removing container" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy"
Oct 31 00:53:24.240100 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.239928    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy"
Oct 31 00:53:24.240100 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.239953    5925 cpu_manager.go:414] "containerMap: removing container" podUID="59202309-1f40-4f2d-8ea3-04a6995153a9" containerName="maas-api"
Oct 31 00:53:24.240100 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.239961    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59202309-1f40-4f2d-8ea3-04a6995153a9" containerName="maas-api"
Oct 31 00:53:24.240301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.240107    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c9e243d-6dac-4eda-9909-e9f17fe49aad" containerName="maas-api"
Oct 31 00:53:24.240301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.240123    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f901144-1cdf-4096-af9e-0494e5ad8402" containerName="istio-proxy"
Oct 31 00:53:24.240301 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.240136    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="59202309-1f40-4f2d-8ea3-04a6995153a9" containerName="maas-api"
Oct 31 00:53:24.243795 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.243773    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.294454 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.294395    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-bc2453-serving-cert\""
Oct 31 00:53:24.298788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.298757    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"]
Oct 31 00:53:24.305247 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.305217    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kws8c\" (UniqueName: \"kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.305400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.305336    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.305400 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.305364    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.305524 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.305510    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.407240 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.407200    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kws8c\" (UniqueName: \"kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.407438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.407385    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.407574 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.407444    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.407574 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:24.407501    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-serving-cert: secret "maas-api-e2e-inf-b-bc2453-serving-cert" not found
Oct 31 00:53:24.407574 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:24.407563    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls podName:71f9e3c6-ef70-4c32-87bd-f75b5c03cde6 nodeName:}" failed. No retries permitted until 2026-10-31 00:53:24.907546817 +0000 UTC m=+2306.596426754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls") pod "maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" (UID: "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6") : secret "maas-api-e2e-inf-b-bc2453-serving-cert" not found
Oct 31 00:53:24.407723 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.407596    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.408432 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.408393    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.410188 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.410161    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.475356 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.475320    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kws8c\" (UniqueName: \"kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.929915 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.929872    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:24.932460 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:24.932435    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\") pod \"maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:25.157310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:25.157277    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:25.547595 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:25.547504    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"]
Oct 31 00:53:25.553578 ip-10-0-140-47 kubenswrapper[5925]: W1031 00:53:25.553551    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f9e3c6_ef70_4c32_87bd_f75b5c03cde6.slice/crio-4f87657d720df0206e21f4fc4d7bac83bb64f44609e90284057a6a568b7a99a3 WatchSource:0}: Error finding container 4f87657d720df0206e21f4fc4d7bac83bb64f44609e90284057a6a568b7a99a3: Status 404 returned error can't find the container with id 4f87657d720df0206e21f4fc4d7bac83bb64f44609e90284057a6a568b7a99a3
Oct 31 00:53:25.897508 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:25.897470    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" event={"ID":"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6","Type":"ContainerStarted","Data":"4f87657d720df0206e21f4fc4d7bac83bb64f44609e90284057a6a568b7a99a3"}
Oct 31 00:53:26.907206 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:26.907166    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" event={"ID":"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6","Type":"ContainerStarted","Data":"13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec"}
Oct 31 00:53:26.907730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:26.907390    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:27.022589 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:27.022524    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" podStartSLOduration=2.167299663 podStartE2EDuration="3.022506949s" totalImagesPullingTime="855.207286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:53:27.020007811 +0000 UTC m=+2308.708887775" watchObservedRunningTime="2026-10-31 00:53:27.022506949 +0000 UTC m=+2308.711386896"
Oct 31 00:53:32.918973 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:32.918941    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:53:39.765993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:39.765952    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"]
Oct 31 00:53:39.766533 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:39.766203    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc" podUID="b942fc86-881c-413d-87a7-b33d47978233" containerName="maas-api" containerID="cri-o://e5b60bc5828c8191d05d085f35d923cddcb582e8678130cbb184d67308cf6a14" gracePeriod=30
Oct 31 00:53:40.027219 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.026876    5925 generic.go:356] "Generic (PLEG): container finished" podID="b942fc86-881c-413d-87a7-b33d47978233" containerID="e5b60bc5828c8191d05d085f35d923cddcb582e8678130cbb184d67308cf6a14" exitCode=0
Oct 31 00:53:40.027219 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.027073    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc" event={"ID":"b942fc86-881c-413d-87a7-b33d47978233","Type":"ContainerDied","Data":"e5b60bc5828c8191d05d085f35d923cddcb582e8678130cbb184d67308cf6a14"}
Oct 31 00:53:40.086593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.086563    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:53:40.139844 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.139812    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz\" (UniqueName: \"kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz\") pod \"b942fc86-881c-413d-87a7-b33d47978233\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") "
Oct 31 00:53:40.140023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.139976    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls\") pod \"b942fc86-881c-413d-87a7-b33d47978233\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") "
Oct 31 00:53:40.140023 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.140010    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs\") pod \"b942fc86-881c-413d-87a7-b33d47978233\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") "
Oct 31 00:53:40.140133 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.140101    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca\") pod \"b942fc86-881c-413d-87a7-b33d47978233\" (UID: \"b942fc86-881c-413d-87a7-b33d47978233\") "
Oct 31 00:53:40.140554 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.140528    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca" pod "b942fc86-881c-413d-87a7-b33d47978233" (UID: "b942fc86-881c-413d-87a7-b33d47978233"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:53:40.142157 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.142113    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls" pod "b942fc86-881c-413d-87a7-b33d47978233" (UID: "b942fc86-881c-413d-87a7-b33d47978233"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:53:40.142275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.142207    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs" pod "b942fc86-881c-413d-87a7-b33d47978233" (UID: "b942fc86-881c-413d-87a7-b33d47978233"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:53:40.142275 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.142226    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz" pod "b942fc86-881c-413d-87a7-b33d47978233" (UID: "b942fc86-881c-413d-87a7-b33d47978233"). InnerVolumeSpecName "kube-api-access-9zdwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:40.241792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.241754    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b942fc86-881c-413d-87a7-b33d47978233-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:40.241792 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.241789    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zdwz\" (UniqueName: \"kubernetes.io/projected/b942fc86-881c-413d-87a7-b33d47978233-kube-api-access-9zdwz\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:40.242058 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.241805    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:40.242058 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:40.241818    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b942fc86-881c-413d-87a7-b33d47978233-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:41.041014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:41.036473    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"
Oct 31 00:53:41.041014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:41.036481    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc" event={"ID":"b942fc86-881c-413d-87a7-b33d47978233","Type":"ContainerDied","Data":"f41d22937f5e16a438f036f8414aed0bb9627507222a6e2b751fec8715106919"}
Oct 31 00:53:41.041014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:41.036548    5925 scope.go:122] "RemoveContainer" containerID="e5b60bc5828c8191d05d085f35d923cddcb582e8678130cbb184d67308cf6a14"
Oct 31 00:53:41.195973 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:41.195935    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"]
Oct 31 00:53:41.243104 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:41.243072    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-e8ba06-86689dbbfc-lgbtc"]
Oct 31 00:53:42.455755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:42.455714    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b942fc86-881c-413d-87a7-b33d47978233" path="/var/lib/kubelet/pods/b942fc86-881c-413d-87a7-b33d47978233/volumes"
Oct 31 00:53:46.543072 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:46.543033    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:53:49.206364 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:49.206330    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"]
Oct 31 00:53:49.206781 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:49.206569    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy" containerID="cri-o://e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805" gracePeriod=30
Oct 31 00:53:54.502905 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.502879    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:53:54.641926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.641891    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642117 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.641935    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642117 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642058    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642117 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642100    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642129    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642173    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:54.642298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642206    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642253    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:54.642298 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642269    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642372    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642392    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:54.642584 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642409    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token\") pod \"a2c046db-5996-4ed9-bb09-d52ea6d80057\" (UID: \"a2c046db-5996-4ed9-bb09-d52ea6d80057\") "
Oct 31 00:53:54.642748 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642640    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:54.642849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.642824    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:53:54.643498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.643370    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.643498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.643396    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.643498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.643409    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2c046db-5996-4ed9-bb09-d52ea6d80057-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.643498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.643465    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.643498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.643479    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.645105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.645037    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:54.645105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.645066    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:53:54.645105 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.645094    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "kube-api-access-sgzgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:53:54.645273 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.645127    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy" pod "a2c046db-5996-4ed9-bb09-d52ea6d80057" (UID: "a2c046db-5996-4ed9-bb09-d52ea6d80057"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:53:54.744535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.744465    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.744535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.744490    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.744535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.744502    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgzgl\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-kube-api-access-sgzgl\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:54.744535 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:54.744512    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2c046db-5996-4ed9-bb09-d52ea6d80057-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:53:55.152879 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.152836    5925 generic.go:356] "Generic (PLEG): container finished" podID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerID="e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805" exitCode=0
Oct 31 00:53:55.153060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.152877    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" event={"ID":"a2c046db-5996-4ed9-bb09-d52ea6d80057","Type":"ContainerDied","Data":"e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805"}
Oct 31 00:53:55.153060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.152921    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"
Oct 31 00:53:55.153060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.152953    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv" event={"ID":"a2c046db-5996-4ed9-bb09-d52ea6d80057","Type":"ContainerDied","Data":"acd8c03b9b545faf59ba3b772f61770588c1aefe59336e1166ae46721bf85ef6"}
Oct 31 00:53:55.153060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.152986    5925 scope.go:122] "RemoveContainer" containerID="e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805"
Oct 31 00:53:55.164803 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.164783    5925 scope.go:122] "RemoveContainer" containerID="e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805"
Oct 31 00:53:55.165057 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:53:55.165038    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805\": container with ID starting with e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805 not found: ID does not exist" containerID="e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805"
Oct 31 00:53:55.165139 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.165066    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805"} err="failed to get container status \"e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805\": rpc error: code = NotFound desc = could not find container \"e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805\": container with ID starting with e870d2f3effbb18f47cc2126422212db3b04027697b6ae7a1ee4fc832b8b4805 not found: ID does not exist"
Oct 31 00:53:55.312401 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.312358    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"]
Oct 31 00:53:55.358887 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:55.358859    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-e8ba06-openshift-default-654dcd546f-d96gv"]
Oct 31 00:53:56.453131 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:53:56.453095    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" path="/var/lib/kubelet/pods/a2c046db-5996-4ed9-bb09-d52ea6d80057/volumes"
Oct 31 00:54:01.110888 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.110851    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"]
Oct 31 00:54:01.111335 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.111055    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" podUID="a25fa42d-95af-49ba-be70-bc778c833e0e" containerName="maas-api" containerID="cri-o://5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942" gracePeriod=30
Oct 31 00:54:01.438903 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.438875    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:54:01.528996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.528953    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\") pod \"a25fa42d-95af-49ba-be70-bc778c833e0e\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") "
Oct 31 00:54:01.540231 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.540201    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs\") pod \"a25fa42d-95af-49ba-be70-bc778c833e0e\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") "
Oct 31 00:54:01.544436 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.540555    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca\") pod \"a25fa42d-95af-49ba-be70-bc778c833e0e\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") "
Oct 31 00:54:01.550434 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.545187    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz\" (UniqueName: \"kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz\") pod \"a25fa42d-95af-49ba-be70-bc778c833e0e\" (UID: \"a25fa42d-95af-49ba-be70-bc778c833e0e\") "
Oct 31 00:54:01.570645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.538276    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls" pod "a25fa42d-95af-49ba-be70-bc778c833e0e" (UID: "a25fa42d-95af-49ba-be70-bc778c833e0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:01.570645 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.570563    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca" pod "a25fa42d-95af-49ba-be70-bc778c833e0e" (UID: "a25fa42d-95af-49ba-be70-bc778c833e0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:54:01.573151 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.573113    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs" pod "a25fa42d-95af-49ba-be70-bc778c833e0e" (UID: "a25fa42d-95af-49ba-be70-bc778c833e0e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:01.575591 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.575557    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz" pod "a25fa42d-95af-49ba-be70-bc778c833e0e" (UID: "a25fa42d-95af-49ba-be70-bc778c833e0e"). InnerVolumeSpecName "kube-api-access-mgkxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:01.652321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.652288    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:01.652321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.652320    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a25fa42d-95af-49ba-be70-bc778c833e0e-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:01.652566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.652331    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgkxz\" (UniqueName: \"kubernetes.io/projected/a25fa42d-95af-49ba-be70-bc778c833e0e-kube-api-access-mgkxz\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:01.652566 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:01.652341    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a25fa42d-95af-49ba-be70-bc778c833e0e-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:02.206762 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.206722    5925 generic.go:356] "Generic (PLEG): container finished" podID="a25fa42d-95af-49ba-be70-bc778c833e0e" containerID="5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942" exitCode=0
Oct 31 00:54:02.207215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.206774    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"
Oct 31 00:54:02.207215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.206809    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" event={"ID":"a25fa42d-95af-49ba-be70-bc778c833e0e","Type":"ContainerDied","Data":"5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942"}
Oct 31 00:54:02.207215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.206870    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh" event={"ID":"a25fa42d-95af-49ba-be70-bc778c833e0e","Type":"ContainerDied","Data":"4a63c7b8ce0201232d9cce3fad3524bcce6c212e9d9b7d8472c1454c40bd91d9"}
Oct 31 00:54:02.207215 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.206900    5925 scope.go:122] "RemoveContainer" containerID="5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942"
Oct 31 00:54:02.221653 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.219845    5925 scope.go:122] "RemoveContainer" containerID="5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942"
Oct 31 00:54:02.221653 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:02.220950    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942\": container with ID starting with 5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942 not found: ID does not exist" containerID="5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942"
Oct 31 00:54:02.221653 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.220987    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942"} err="failed to get container status \"5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942\": rpc error: code = NotFound desc = could not find container \"5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942\": container with ID starting with 5257a3821cfef64055e6ad42dd86767cb62e106fc3f7001e712d057f25124942 not found: ID does not exist"
Oct 31 00:54:02.367348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.367308    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"]
Oct 31 00:54:02.412558 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.412525    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-50a19d-6cb45fcf88-8ntfh"]
Oct 31 00:54:02.457775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.457680    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a25fa42d-95af-49ba-be70-bc778c833e0e" path="/var/lib/kubelet/pods/a25fa42d-95af-49ba-be70-bc778c833e0e/volumes"
Oct 31 00:54:02.803076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.802975    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"]
Oct 31 00:54:02.803967 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.803272    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy" containerID="cri-o://9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc" gracePeriod=30
Oct 31 00:54:02.818303 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.818270    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"]
Oct 31 00:54:02.818589 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.818551    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy" containerID="cri-o://5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765" gracePeriod=30
Oct 31 00:54:02.829727 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.829698    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"]
Oct 31 00:54:02.829907 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:02.829886    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy" containerID="cri-o://04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee" gracePeriod=30
Oct 31 00:54:08.133385 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.133253    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:54:08.160360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.160332    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:54:08.190480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.190454    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:54:08.250265 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.250230    5925 generic.go:356] "Generic (PLEG): container finished" podID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerID="04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee" exitCode=0
Oct 31 00:54:08.250512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.250282    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"
Oct 31 00:54:08.250512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.250316    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" event={"ID":"396874bf-c0a1-478b-9d1b-8e31e660a0d1","Type":"ContainerDied","Data":"04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee"}
Oct 31 00:54:08.250512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.250381    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42" event={"ID":"396874bf-c0a1-478b-9d1b-8e31e660a0d1","Type":"ContainerDied","Data":"776a921e8ed0240e8473b9716c701628efc647f647d5f5cca1b5a6a497f3cd6c"}
Oct 31 00:54:08.250512 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.250442    5925 scope.go:122] "RemoveContainer" containerID="04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee"
Oct 31 00:54:08.252037 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.252012    5925 generic.go:356] "Generic (PLEG): container finished" podID="4bb05242-7d96-400b-a491-2bf321c2d625" containerID="5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765" exitCode=0
Oct 31 00:54:08.252154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.252053    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" event={"ID":"4bb05242-7d96-400b-a491-2bf321c2d625","Type":"ContainerDied","Data":"5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765"}
Oct 31 00:54:08.252154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.252100    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"
Oct 31 00:54:08.252241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.252107    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n" event={"ID":"4bb05242-7d96-400b-a491-2bf321c2d625","Type":"ContainerDied","Data":"1b58e468dc32e3709a2f541f598340f720bdaca4cefba28228eca862a05ef12a"}
Oct 31 00:54:08.253737 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.253713    5925 generic.go:356] "Generic (PLEG): container finished" podID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerID="9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc" exitCode=0
Oct 31 00:54:08.253831 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.253779    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"
Oct 31 00:54:08.253831 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.253799    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" event={"ID":"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f","Type":"ContainerDied","Data":"9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc"}
Oct 31 00:54:08.253954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.253840    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97" event={"ID":"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f","Type":"ContainerDied","Data":"349f949d077fd160bf31316bd1facb6c8cf4195702a5f2e3b9cc3a5770f640a3"}
Oct 31 00:54:08.257081 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257060    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257183 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257101    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257183 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257134    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257183 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257172    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257394 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257331    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257394 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257344    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.257394 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257359    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257459    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257570    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.257674 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257601    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:54:08.257674 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257612    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.257759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257682    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm\") pod \"4bb05242-7d96-400b-a491-2bf321c2d625\" (UID: \"4bb05242-7d96-400b-a491-2bf321c2d625\") "
Oct 31 00:54:08.258182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257882    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.258182 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.257782    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.258317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.258296    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.258360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.258327    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.258360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.258342    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bb05242-7d96-400b-a491-2bf321c2d625-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.258360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.258357    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.258485 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.258371    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.259989 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.259844    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:54:08.259989 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.259957    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:08.260144 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.260028    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "kube-api-access-4vxhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:08.260319 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.260296    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy" pod "4bb05242-7d96-400b-a491-2bf321c2d625" (UID: "4bb05242-7d96-400b-a491-2bf321c2d625"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.262380 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.262362    5925 scope.go:122] "RemoveContainer" containerID="04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee"
Oct 31 00:54:08.262714 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:08.262682    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee\": container with ID starting with 04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee not found: ID does not exist" containerID="04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee"
Oct 31 00:54:08.262806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.262725    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee"} err="failed to get container status \"04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee\": rpc error: code = NotFound desc = could not find container \"04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee\": container with ID starting with 04ecb095d9c65fa01ae1f06fe60217a277bcb0f7655c739ee194484cd09afbee not found: ID does not exist"
Oct 31 00:54:08.262806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.262745    5925 scope.go:122] "RemoveContainer" containerID="5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765"
Oct 31 00:54:08.272511 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.272492    5925 scope.go:122] "RemoveContainer" containerID="5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765"
Oct 31 00:54:08.272840 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:08.272812    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765\": container with ID starting with 5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765 not found: ID does not exist" containerID="5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765"
Oct 31 00:54:08.272891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.272851    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765"} err="failed to get container status \"5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765\": rpc error: code = NotFound desc = could not find container \"5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765\": container with ID starting with 5c0fb962f79164af0da6697755947ff4ce3fa9f18322a1efd69ed65a78cf9765 not found: ID does not exist"
Oct 31 00:54:08.272891 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.272875    5925 scope.go:122] "RemoveContainer" containerID="9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc"
Oct 31 00:54:08.282202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.282184    5925 scope.go:122] "RemoveContainer" containerID="9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc"
Oct 31 00:54:08.282481 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:08.282455    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc\": container with ID starting with 9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc not found: ID does not exist" containerID="9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc"
Oct 31 00:54:08.282557 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.282489    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc"} err="failed to get container status \"9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc\": rpc error: code = NotFound desc = could not find container \"9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc\": container with ID starting with 9bc12e9e80b60a1f4bceca6ddac9ec15c47319e7d7e78fe9b59d3be4df2215bc not found: ID does not exist"
Oct 31 00:54:08.359423 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359332    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.359423 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359368    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.359423 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359401    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.359724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359457    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.359724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359551    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.359724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359628    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.359724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359669    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.359724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359689    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.359724 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359706    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359741    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359796    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359851    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359886    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359917    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9\") pod \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\" (UID: \"396874bf-c0a1-478b-9d1b-8e31e660a0d1\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359954    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.359974    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360010    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.360065 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360053    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.360548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360093    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.360548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360146    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data\") pod \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\" (UID: \"f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f\") "
Oct 31 00:54:08.360548 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360345    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.360729 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360585    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.360729 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360685    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:54:08.360917 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.360890    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361343    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361376    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vxhm\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-kube-api-access-4vxhm\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361393    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361409    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bb05242-7d96-400b-a491-2bf321c2d625-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361439    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bb05242-7d96-400b-a491-2bf321c2d625-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361454    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361468    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361483    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361496    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bb05242-7d96-400b-a491-2bf321c2d625-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361511    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361345    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.361869    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:54:08.362482 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.362149    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.363380 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.362702    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:08.363380 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.362927    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.363809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.363768    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.363809 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.363771    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:54:08.363954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.363841    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:08.364025 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.364003    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "kube-api-access-nk9sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:08.364202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.364181    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy" pod "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" (UID: "f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:08.365116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.365094    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:54:08.365306 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.365286    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9" pod "396874bf-c0a1-478b-9d1b-8e31e660a0d1" (UID: "396874bf-c0a1-478b-9d1b-8e31e660a0d1"). InnerVolumeSpecName "kube-api-access-4tsz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:08.462156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462118    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462150    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462156 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462163    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462177    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tsz9\" (UniqueName: \"kubernetes.io/projected/396874bf-c0a1-478b-9d1b-8e31e660a0d1-kube-api-access-4tsz9\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462191    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462203    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462214    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk9sv\" (UniqueName: \"kubernetes.io/projected/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-kube-api-access-nk9sv\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462230    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462242    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462253    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462266    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.462469 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.462277    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/396874bf-c0a1-478b-9d1b-8e31e660a0d1-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:08.695471 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.695359    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"]
Oct 31 00:54:08.700181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.700148    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lzt2n"]
Oct 31 00:54:08.803889 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.803857    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"]
Oct 31 00:54:08.811795 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.811759    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-dln97"]
Oct 31 00:54:08.914375 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.914332    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"]
Oct 31 00:54:08.918827 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:08.918798    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7d5f4de7-openshift-default-55c88dfdbf-lkp42"]
Oct 31 00:54:10.454739 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:10.454701    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" path="/var/lib/kubelet/pods/396874bf-c0a1-478b-9d1b-8e31e660a0d1/volumes"
Oct 31 00:54:10.455360 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:10.455342    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" path="/var/lib/kubelet/pods/4bb05242-7d96-400b-a491-2bf321c2d625/volumes"
Oct 31 00:54:10.455835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:10.455818    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" path="/var/lib/kubelet/pods/f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f/volumes"
Oct 31 00:54:16.552992 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:16.552927    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:54:28.029926 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:28.029888    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"]
Oct 31 00:54:28.077372 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:28.077334    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"]
Oct 31 00:54:34.431587 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:34.431527    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:54:34.431993 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:34.431639    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:54:43.051777 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.051727    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main" containerID="cri-o://1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7" gracePeriod=45
Oct 31 00:54:43.090437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.090371    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main" probeResult="failure" output="Get \"https://10.132.0.83:8000/ready\": dial tcp 10.132.0.83:8000: connect: connection refused"
Oct 31 00:54:43.099054 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.099020    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main" containerID="cri-o://e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e" gracePeriod=45
Oct 31 00:54:43.142026 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.141991    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": dial tcp 10.132.0.79:8000: connect: connection refused"
Oct 31 00:54:43.376430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.376391    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:54:43.418483 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.418453    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:54:43.504406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.504373    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm\") pod \"13f5d606-d28a-41e7-88ea-28d00d92f286\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") "
Oct 31 00:54:43.504406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.504454    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home\") pod \"13f5d606-d28a-41e7-88ea-28d00d92f286\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") "
Oct 31 00:54:43.504705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.504494    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7\" (UniqueName: \"kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7\") pod \"13f5d606-d28a-41e7-88ea-28d00d92f286\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") "
Oct 31 00:54:43.504705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.504534    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache\") pod \"13f5d606-d28a-41e7-88ea-28d00d92f286\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") "
Oct 31 00:54:43.504705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.504566    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir\") pod \"13f5d606-d28a-41e7-88ea-28d00d92f286\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") "
Oct 31 00:54:43.504705 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.504688    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs\" (UniqueName: \"kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs\") pod \"13f5d606-d28a-41e7-88ea-28d00d92f286\" (UID: \"13f5d606-d28a-41e7-88ea-28d00d92f286\") "
Oct 31 00:54:43.505603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.505116    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home" pod "13f5d606-d28a-41e7-88ea-28d00d92f286" (UID: "13f5d606-d28a-41e7-88ea-28d00d92f286"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.505603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.505189    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache" pod "13f5d606-d28a-41e7-88ea-28d00d92f286" (UID: "13f5d606-d28a-41e7-88ea-28d00d92f286"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.505603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.505302    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir" pod "13f5d606-d28a-41e7-88ea-28d00d92f286" (UID: "13f5d606-d28a-41e7-88ea-28d00d92f286"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.505603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.505540    5925 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-home\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.505603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.505561    5925 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-model-cache\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.505603 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.505579    5925 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-tmp-dir\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.507820 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.507783    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7" pod "13f5d606-d28a-41e7-88ea-28d00d92f286" (UID: "13f5d606-d28a-41e7-88ea-28d00d92f286"). InnerVolumeSpecName "kube-api-access-p4sl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:43.510155 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.509525    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm" pod "13f5d606-d28a-41e7-88ea-28d00d92f286" (UID: "13f5d606-d28a-41e7-88ea-28d00d92f286"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.510155 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.509534    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs" pod "13f5d606-d28a-41e7-88ea-28d00d92f286" (UID: "13f5d606-d28a-41e7-88ea-28d00d92f286"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:43.606638 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.606538    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir\") pod \"125105e1-e44b-49f1-81df-b6bfa16d1602\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") "
Oct 31 00:54:43.606806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.606654    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home\") pod \"125105e1-e44b-49f1-81df-b6bfa16d1602\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") "
Oct 31 00:54:43.606806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.606705    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7\" (UniqueName: \"kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7\") pod \"125105e1-e44b-49f1-81df-b6bfa16d1602\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") "
Oct 31 00:54:43.606806 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.606797    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs\" (UniqueName: \"kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs\") pod \"125105e1-e44b-49f1-81df-b6bfa16d1602\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") "
Oct 31 00:54:43.606991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.606858    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache\") pod \"125105e1-e44b-49f1-81df-b6bfa16d1602\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") "
Oct 31 00:54:43.606991 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.606941    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm\") pod \"125105e1-e44b-49f1-81df-b6bfa16d1602\" (UID: \"125105e1-e44b-49f1-81df-b6bfa16d1602\") "
Oct 31 00:54:43.607883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.607709    5925 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13f5d606-d28a-41e7-88ea-28d00d92f286-dshm\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.607883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.607737    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4sl7\" (UniqueName: \"kubernetes.io/projected/13f5d606-d28a-41e7-88ea-28d00d92f286-kube-api-access-p4sl7\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.607883 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.607759    5925 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13f5d606-d28a-41e7-88ea-28d00d92f286-tls-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.610632 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.610288    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir" pod "125105e1-e44b-49f1-81df-b6bfa16d1602" (UID: "125105e1-e44b-49f1-81df-b6bfa16d1602"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.611050 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.610851    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home" pod "125105e1-e44b-49f1-81df-b6bfa16d1602" (UID: "125105e1-e44b-49f1-81df-b6bfa16d1602"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.611578 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.611225    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache" pod "125105e1-e44b-49f1-81df-b6bfa16d1602" (UID: "125105e1-e44b-49f1-81df-b6bfa16d1602"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.611696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.611663    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7" pod "125105e1-e44b-49f1-81df-b6bfa16d1602" (UID: "125105e1-e44b-49f1-81df-b6bfa16d1602"). InnerVolumeSpecName "kube-api-access-ghhz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:43.616834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.616811    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs" pod "125105e1-e44b-49f1-81df-b6bfa16d1602" (UID: "125105e1-e44b-49f1-81df-b6bfa16d1602"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:43.618074 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.618048    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm" pod "125105e1-e44b-49f1-81df-b6bfa16d1602" (UID: "125105e1-e44b-49f1-81df-b6bfa16d1602"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:43.709489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.709452    5925 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-dshm\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.709489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.709484    5925 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-tmp-dir\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.709489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.709493    5925 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-home\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.709725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.709502    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghhz7\" (UniqueName: \"kubernetes.io/projected/125105e1-e44b-49f1-81df-b6bfa16d1602-kube-api-access-ghhz7\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.709725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.709513    5925 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/125105e1-e44b-49f1-81df-b6bfa16d1602-tls-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.709725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.709521    5925 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/125105e1-e44b-49f1-81df-b6bfa16d1602-model-cache\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:43.817852 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.817811    5925 generic.go:356] "Generic (PLEG): container finished" podID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerID="e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e" exitCode=0
Oct 31 00:54:43.818067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.817864    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"
Oct 31 00:54:43.818067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.817911    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" event={"ID":"125105e1-e44b-49f1-81df-b6bfa16d1602","Type":"ContainerDied","Data":"e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e"}
Oct 31 00:54:43.818067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.817977    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq" event={"ID":"125105e1-e44b-49f1-81df-b6bfa16d1602","Type":"ContainerDied","Data":"8e4f6b3c096d77176354c1dfa23bfa0d7d83891bc9dfd0131da03463fe48a1c0"}
Oct 31 00:54:43.818067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.818002    5925 scope.go:122] "RemoveContainer" containerID="e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e"
Oct 31 00:54:43.819610 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.819580    5925 generic.go:356] "Generic (PLEG): container finished" podID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerID="1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7" exitCode=0
Oct 31 00:54:43.819760 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.819634    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"
Oct 31 00:54:43.819760 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.819657    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" event={"ID":"13f5d606-d28a-41e7-88ea-28d00d92f286","Type":"ContainerDied","Data":"1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7"}
Oct 31 00:54:43.819760 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.819690    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8" event={"ID":"13f5d606-d28a-41e7-88ea-28d00d92f286","Type":"ContainerDied","Data":"2fc300052b08d54b35c62dccb4468b3858c7808a7160816990b97af88f309346"}
Oct 31 00:54:43.829955 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.829830    5925 scope.go:122] "RemoveContainer" containerID="e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e"
Oct 31 00:54:43.831065 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:43.831039    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e\": container with ID starting with e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e not found: ID does not exist" containerID="e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e"
Oct 31 00:54:43.831190 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.831110    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e"} err="failed to get container status \"e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e\": rpc error: code = NotFound desc = could not find container \"e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e\": container with ID starting with e1a52f4348bf9da019cfc02f4b8da2dbcf44b2e4eb42ec1f975575f02a7e8c0e not found: ID does not exist"
Oct 31 00:54:43.831190 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.831140    5925 scope.go:122] "RemoveContainer" containerID="1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7"
Oct 31 00:54:43.841899 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.841875    5925 scope.go:122] "RemoveContainer" containerID="1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7"
Oct 31 00:54:43.842193 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:43.842173    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7\": container with ID starting with 1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7 not found: ID does not exist" containerID="1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7"
Oct 31 00:54:43.842261 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.842207    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7"} err="failed to get container status \"1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7\": rpc error: code = NotFound desc = could not find container \"1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7\": container with ID starting with 1219265bae9f232e92e55c5aa278a663c1c7112c2626d467e841824dcf238fb7 not found: ID does not exist"
Oct 31 00:54:43.977347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:43.977251    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"]
Oct 31 00:54:44.024922 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:44.024886    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-w6-a6f4a5-kserve-c774769d4-5p9hq"]
Oct 31 00:54:44.085834 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:44.085801    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"]
Oct 31 00:54:44.090346 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:44.090318    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-a6f4a5/distinct-2-w6-a6f4a5-kserve-bfbf4bc5f-r64z8"]
Oct 31 00:54:44.453382 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:44.453348    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" path="/var/lib/kubelet/pods/125105e1-e44b-49f1-81df-b6bfa16d1602/volumes"
Oct 31 00:54:44.453833 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:44.453818    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" path="/var/lib/kubelet/pods/13f5d606-d28a-41e7-88ea-28d00d92f286/volumes"
Oct 31 00:54:46.545007 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:54:46.544969    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:54:58.883617 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:58.883573    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:54:58.888195 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:54:58.888153    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:55:06.452564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:06.452530    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"]
Oct 31 00:55:06.453027 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:06.452749    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy" containerID="cri-o://19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728" gracePeriod=30
Oct 31 00:55:11.724862 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.724792    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:55:11.873733 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.873694    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.873954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.873827    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.873954 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.873913    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.873954    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874067 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.873984    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874075    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874154 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874104    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874238    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874325 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874286    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert\") pod \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\" (UID: \"c37aa8b1-450e-4dfd-965e-29b11ccaad9c\") "
Oct 31 00:55:11.874452 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874399    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:11.874867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874845    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.874996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874850    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:11.874996 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.874937    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:55:11.875234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.875180    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:11.875704 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.875676    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:11.876461 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.876434    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:55:11.877662 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.877633    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "kube-api-access-89577". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:11.877893 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.877873    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:11.886490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.886376    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token" pod "c37aa8b1-450e-4dfd-965e-29b11ccaad9c" (UID: "c37aa8b1-450e-4dfd-965e-29b11ccaad9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975642    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975670    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975680    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975689    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975698    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975706    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89577\" (UniqueName: \"kubernetes.io/projected/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-kube-api-access-89577\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975717    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:11.975725 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:11.975729    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c37aa8b1-450e-4dfd-965e-29b11ccaad9c-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:12.057180 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.057141    5925 generic.go:356] "Generic (PLEG): container finished" podID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerID="19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728" exitCode=0
Oct 31 00:55:12.057368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.057192    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"
Oct 31 00:55:12.057368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.057218    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" event={"ID":"c37aa8b1-450e-4dfd-965e-29b11ccaad9c","Type":"ContainerDied","Data":"19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728"}
Oct 31 00:55:12.057368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.057270    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s" event={"ID":"c37aa8b1-450e-4dfd-965e-29b11ccaad9c","Type":"ContainerDied","Data":"8fb2cedeee983040269b7b432476c5182a97ce8d04a74503894206350ef3a54f"}
Oct 31 00:55:12.057368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.057292    5925 scope.go:122] "RemoveContainer" containerID="19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728"
Oct 31 00:55:12.068377 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.068358    5925 scope.go:122] "RemoveContainer" containerID="7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"
Oct 31 00:55:12.077726 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.077707    5925 scope.go:122] "RemoveContainer" containerID="19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728"
Oct 31 00:55:12.077981 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:55:12.077962    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728\": container with ID starting with 19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728 not found: ID does not exist" containerID="19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728"
Oct 31 00:55:12.078029 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.077992    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728"} err="failed to get container status \"19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728\": rpc error: code = NotFound desc = could not find container \"19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728\": container with ID starting with 19114d0106b80f54ca09837744a4d4439290a7ca8b31f2f190a652ad914a6728 not found: ID does not exist"
Oct 31 00:55:12.078029 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.078013    5925 scope.go:122] "RemoveContainer" containerID="7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"
Oct 31 00:55:12.078269 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:55:12.078251    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73\": container with ID starting with 7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73 not found: ID does not exist" containerID="7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"
Oct 31 00:55:12.078311 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.078275    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73"} err="failed to get container status \"7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73\": rpc error: code = NotFound desc = could not find container \"7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73\": container with ID starting with 7372ae82ababd37dc6223653447e6d0263fe83837086233fc17a21bbe8037d73 not found: ID does not exist"
Oct 31 00:55:12.217655 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.217622    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"]
Oct 31 00:55:12.265909 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.265826    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-412743-openshift-default-7bddc8b5df-cg79s"]
Oct 31 00:55:12.452716 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:12.452681    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" path="/var/lib/kubelet/pods/c37aa8b1-450e-4dfd-965e-29b11ccaad9c/volumes"
Oct 31 00:55:16.542759 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:55:16.542719    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:55:25.371321 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.371282    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"]
Oct 31 00:55:25.371772 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.371520    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" podUID="cdffdf92-1a6e-4f0e-8046-a8459e04262c" containerName="maas-api" containerID="cri-o://2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352" gracePeriod=30
Oct 31 00:55:25.672503 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.672474    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:55:25.747153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.747113    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8\" (UniqueName: \"kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8\") pod \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") "
Oct 31 00:55:25.747368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.747269    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca\") pod \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") "
Oct 31 00:55:25.747368 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.747324    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\") pod \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") "
Oct 31 00:55:25.747498 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.747374    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs\") pod \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\" (UID: \"cdffdf92-1a6e-4f0e-8046-a8459e04262c\") "
Oct 31 00:55:25.747670 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.747637    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca" pod "cdffdf92-1a6e-4f0e-8046-a8459e04262c" (UID: "cdffdf92-1a6e-4f0e-8046-a8459e04262c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:55:25.747861 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.747845    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cdffdf92-1a6e-4f0e-8046-a8459e04262c-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:25.750111 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.750074    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls" pod "cdffdf92-1a6e-4f0e-8046-a8459e04262c" (UID: "cdffdf92-1a6e-4f0e-8046-a8459e04262c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:55:25.750250 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.750226    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8" pod "cdffdf92-1a6e-4f0e-8046-a8459e04262c" (UID: "cdffdf92-1a6e-4f0e-8046-a8459e04262c"). InnerVolumeSpecName "kube-api-access-77wm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:25.750250 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.750230    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs" pod "cdffdf92-1a6e-4f0e-8046-a8459e04262c" (UID: "cdffdf92-1a6e-4f0e-8046-a8459e04262c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:55:25.849206 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.849163    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:25.849206 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.849196    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cdffdf92-1a6e-4f0e-8046-a8459e04262c-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:25.849506 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:25.849215    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77wm8\" (UniqueName: \"kubernetes.io/projected/cdffdf92-1a6e-4f0e-8046-a8459e04262c-kube-api-access-77wm8\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:26.157317 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.157281    5925 generic.go:356] "Generic (PLEG): container finished" podID="cdffdf92-1a6e-4f0e-8046-a8459e04262c" containerID="2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352" exitCode=0
Oct 31 00:55:26.157507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.157332    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" event={"ID":"cdffdf92-1a6e-4f0e-8046-a8459e04262c","Type":"ContainerDied","Data":"2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352"}
Oct 31 00:55:26.157507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.157342    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"
Oct 31 00:55:26.157507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.157402    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq" event={"ID":"cdffdf92-1a6e-4f0e-8046-a8459e04262c","Type":"ContainerDied","Data":"938d624c31f764c2fa4ea546788d97ff40e7ab0aec96500ba88c7b076210519f"}
Oct 31 00:55:26.157507 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.157455    5925 scope.go:122] "RemoveContainer" containerID="2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352"
Oct 31 00:55:26.169134 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.169112    5925 scope.go:122] "RemoveContainer" containerID="2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352"
Oct 31 00:55:26.169458 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:55:26.169406    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352\": container with ID starting with 2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352 not found: ID does not exist" containerID="2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352"
Oct 31 00:55:26.169526 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.169468    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352"} err="failed to get container status \"2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352\": rpc error: code = NotFound desc = could not find container \"2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352\": container with ID starting with 2630d20d4b4f989b1f44f700b96f3d0fbac8a38fecc38972d3aadea1d2ff0352 not found: ID does not exist"
Oct 31 00:55:26.317313 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.317275    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"]
Oct 31 00:55:26.323602 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.323569    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1e5e75-f5845f574-699fq"]
Oct 31 00:55:26.453702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:26.453594    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cdffdf92-1a6e-4f0e-8046-a8459e04262c" path="/var/lib/kubelet/pods/cdffdf92-1a6e-4f0e-8046-a8459e04262c/volumes"
Oct 31 00:55:34.878248 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:34.878210    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"]
Oct 31 00:55:34.880116 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:34.879181    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy" containerID="cri-o://d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8" gracePeriod=30
Oct 31 00:55:40.153943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.153872    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:55:40.230229 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230195    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230251    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230397    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230467 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230458    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230489    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230547    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230575    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230569    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230616    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230619    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:40.230663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230657    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo\") pod \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\" (UID: \"f7f279b8-7f43-42cc-81fb-ed4dad1e5428\") "
Oct 31 00:55:40.230985 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230822    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:40.231035 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.230978    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:55:40.231119 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.231053    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:40.231186 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.231164    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.231251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.231192    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.231251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.231208    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.231251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.231222    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.231251 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.231234    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.233073 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.233042    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:40.233272 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.233254    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:55:40.233359 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.233338    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "kube-api-access-4lwq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:40.233441 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.233345    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo" pod "f7f279b8-7f43-42cc-81fb-ed4dad1e5428" (UID: "f7f279b8-7f43-42cc-81fb-ed4dad1e5428"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:55:40.253956 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.253922    5925 generic.go:356] "Generic (PLEG): container finished" podID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerID="d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8" exitCode=0
Oct 31 00:55:40.254110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.253974    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"
Oct 31 00:55:40.254110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.254010    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" event={"ID":"f7f279b8-7f43-42cc-81fb-ed4dad1e5428","Type":"ContainerDied","Data":"d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8"}
Oct 31 00:55:40.254110 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.254088    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t" event={"ID":"f7f279b8-7f43-42cc-81fb-ed4dad1e5428","Type":"ContainerDied","Data":"1facfaad27d7b74babafcd73db243f43c42736dddfcfd751a459c06f1b2669bc"}
Oct 31 00:55:40.254234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.254124    5925 scope.go:122] "RemoveContainer" containerID="d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8"
Oct 31 00:55:40.265223 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.265203    5925 scope.go:122] "RemoveContainer" containerID="d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8"
Oct 31 00:55:40.265564 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:55:40.265535    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8\": container with ID starting with d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8 not found: ID does not exist" containerID="d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8"
Oct 31 00:55:40.265614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.265575    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8"} err="failed to get container status \"d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8\": rpc error: code = NotFound desc = could not find container \"d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8\": container with ID starting with d3eab59a19f07a9a0b94895bb2349c0f40421fb4b81255fc5baf473a1fc60df8 not found: ID does not exist"
Oct 31 00:55:40.332181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.332148    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lwq4\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-kube-api-access-4lwq4\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.332181 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.332182    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.332363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.332198    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.332363 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.332211    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7f279b8-7f43-42cc-81fb-ed4dad1e5428-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:40.425908 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.425822    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"]
Oct 31 00:55:40.431790 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.431758    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-1e5e75-openshift-default-879c67bc5-spb2t"]
Oct 31 00:55:40.451775 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:40.451740    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" path="/var/lib/kubelet/pods/f7f279b8-7f43-42cc-81fb-ed4dad1e5428/volumes"
Oct 31 00:55:46.543205 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:55:46.543168    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:55:57.813478 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:57.741785    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"]
Oct 31 00:55:57.877977 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:55:57.877927    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy" containerID="cri-o://0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060" gracePeriod=30
Oct 31 00:56:03.154947 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.154875    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:56:03.282799 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.282757    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.282817    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.282868    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283003 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.282992    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283048    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283118    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:03.283179 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283147    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283223    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283269    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283348 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283342    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo\") pod \"ad041db5-19f1-4bf7-8bac-917af1adebea\" (UID: \"ad041db5-19f1-4bf7-8bac-917af1adebea\") "
Oct 31 00:56:03.283541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283356    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:03.283541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283371    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:03.283541 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283324    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:56:03.283849 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283223    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:03.283943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283829    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.283943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283879    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad041db5-19f1-4bf7-8bac-917af1adebea-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.283943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283898    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.283943 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.283913    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.285715 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.285684    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:03.285846 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.285821    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:56:03.285941 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.285919    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:03.286202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.286185    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2" pod "ad041db5-19f1-4bf7-8bac-917af1adebea" (UID: "ad041db5-19f1-4bf7-8bac-917af1adebea"). InnerVolumeSpecName "kube-api-access-h54t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:03.385310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.385273    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h54t2\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-kube-api-access-h54t2\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.385310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.385305    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.385310 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.385315    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.385575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.385324    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad041db5-19f1-4bf7-8bac-917af1adebea-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.385575 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.385332    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad041db5-19f1-4bf7-8bac-917af1adebea-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:03.461209 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.461112    5925 generic.go:356] "Generic (PLEG): container finished" podID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerID="0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060" exitCode=0
Oct 31 00:56:03.461209 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.461168    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"
Oct 31 00:56:03.461489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.461211    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" event={"ID":"ad041db5-19f1-4bf7-8bac-917af1adebea","Type":"ContainerDied","Data":"0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060"}
Oct 31 00:56:03.461489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.461278    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc" event={"ID":"ad041db5-19f1-4bf7-8bac-917af1adebea","Type":"ContainerDied","Data":"c95ea9bffbeb2604d96814fdc787a5bbb5243ef75c16fb3f3824e589d0612a17"}
Oct 31 00:56:03.461489 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.461308    5925 scope.go:122] "RemoveContainer" containerID="0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060"
Oct 31 00:56:03.472801 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.472779    5925 scope.go:122] "RemoveContainer" containerID="ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"
Oct 31 00:56:03.483479 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.483451    5925 scope.go:122] "RemoveContainer" containerID="0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060"
Oct 31 00:56:03.484028 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:56:03.484009    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060\": container with ID starting with 0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060 not found: ID does not exist" containerID="0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060"
Oct 31 00:56:03.484118 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.484038    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060"} err="failed to get container status \"0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060\": rpc error: code = NotFound desc = could not find container \"0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060\": container with ID starting with 0600297e387e53c92345554a3c23cc0a97b32a2086e41b266be067b0c27fe060 not found: ID does not exist"
Oct 31 00:56:03.484118 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.484059    5925 scope.go:122] "RemoveContainer" containerID="ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"
Oct 31 00:56:03.484371 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:56:03.484346    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5\": container with ID starting with ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5 not found: ID does not exist" containerID="ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"
Oct 31 00:56:03.484454 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.484380    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5"} err="failed to get container status \"ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5\": rpc error: code = NotFound desc = could not find container \"ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5\": container with ID starting with ceb338bb3485784c3369399934ee52e14fbb0f72f6a6438a589917d4be8af0a5 not found: ID does not exist"
Oct 31 00:56:03.622048 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.622008    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"]
Oct 31 00:56:03.628014 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:03.627985    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-a6f4a5-openshift-default-75d85b9b75-2f6wc"]
Oct 31 00:56:04.454755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:04.454719    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" path="/var/lib/kubelet/pods/ad041db5-19f1-4bf7-8bac-917af1adebea/volumes"
Oct 31 00:56:06.972885 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:06.972839    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"]
Oct 31 00:56:06.973490 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:06.973084    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery" containerID="cri-o://e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f" gracePeriod=30
Oct 31 00:56:07.259462 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.259430    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:56:07.328211 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328171    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328231    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328406 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328346    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328401    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328453    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328547 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328491    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328712 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328551    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f\") pod \"8534c332-459c-4aa9-bdb0-f329a6463f7e\" (UID: \"8534c332-459c-4aa9-bdb0-f329a6463f7e\") "
Oct 31 00:56:07.328997 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.328968    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:56:07.330734 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.330701    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:56:07.330868 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.330734    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:56:07.331089 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.331070    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:07.331226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.331198    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:56:07.331226 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.331215    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:07.331351 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.331243    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f" pod "8534c332-459c-4aa9-bdb0-f329a6463f7e" (UID: "8534c332-459c-4aa9-bdb0-f329a6463f7e"). InnerVolumeSpecName "kube-api-access-l569f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:07.430430 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430389    5925 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-dns-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.430614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430447    5925 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-cacerts\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.430614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430459    5925 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8534c332-459c-4aa9-bdb0-f329a6463f7e-local-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.430614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430468    5925 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-csr-ca-configmap\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.430614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430479    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l569f\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-kube-api-access-l569f\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.430614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430488    5925 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-kubeconfig\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.430614 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.430496    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8534c332-459c-4aa9-bdb0-f329a6463f7e-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:07.491981 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.491897    5925 generic.go:356] "Generic (PLEG): container finished" podID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerID="e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f" exitCode=0
Oct 31 00:56:07.491981 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.491948    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"
Oct 31 00:56:07.492170 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.491973    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" event={"ID":"8534c332-459c-4aa9-bdb0-f329a6463f7e","Type":"ContainerDied","Data":"e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f"}
Oct 31 00:56:07.492170 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.492028    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" event={"ID":"8534c332-459c-4aa9-bdb0-f329a6463f7e","Type":"ContainerDied","Data":"06012d93c84e6fd8c2339474126779cc5c7ec33eb3eb00268fdf9b842d19dfa8"}
Oct 31 00:56:07.492170 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.492048    5925 scope.go:122] "RemoveContainer" containerID="e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f"
Oct 31 00:56:07.503696 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.503678    5925 scope.go:122] "RemoveContainer" containerID="e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f"
Oct 31 00:56:07.503969 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:56:07.503948    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f\": container with ID starting with e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f not found: ID does not exist" containerID="e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f"
Oct 31 00:56:07.504076 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.503974    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f"} err="failed to get container status \"e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f\": rpc error: code = NotFound desc = could not find container \"e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f\": container with ID starting with e8a9b125bfd77c25ace82219b6520c37e3924d859b7c7e45f634bdfbb869317f not found: ID does not exist"
Oct 31 00:56:07.653222 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.652934    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"]
Oct 31 00:56:07.660531 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:07.660500    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h"]
Oct 31 00:56:08.453020 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:08.452977    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" path="/var/lib/kubelet/pods/8534c332-459c-4aa9-bdb0-f329a6463f7e/volumes"
Oct 31 00:56:12.176552 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:12.176506    5925 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-xjq9h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:56:12.176964 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:12.176573    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-xjq9h" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.98:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:56:16.550489 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:56:16.550440    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:56:45.624821 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:45.624785    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"]
Oct 31 00:56:45.625374 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:45.625001    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" containerID="cri-o://16cb4754573ad3f53f611a8421fd12c167b2f5b10ae2acb86850243c786d1ad0" gracePeriod=30
Oct 31 00:56:46.552266 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:56:46.552225    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:56:47.012009 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.011972    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"]
Oct 31 00:56:47.012438 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.012185    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j" podUID="60d3080b-6e9e-4f19-b5dc-adcbcda41402" containerName="maas-api" containerID="cri-o://f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2" gracePeriod=30
Oct 31 00:56:47.290354 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.290328    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:56:47.366908 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.366874    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\") pod \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") "
Oct 31 00:56:47.367097 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.366939    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844\" (UniqueName: \"kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844\") pod \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") "
Oct 31 00:56:47.367097 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.366992    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca\") pod \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") "
Oct 31 00:56:47.367097 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.367043    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs\") pod \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\" (UID: \"60d3080b-6e9e-4f19-b5dc-adcbcda41402\") "
Oct 31 00:56:47.367402 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.367368    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca" pod "60d3080b-6e9e-4f19-b5dc-adcbcda41402" (UID: "60d3080b-6e9e-4f19-b5dc-adcbcda41402"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:56:47.367579 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.367559    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d3080b-6e9e-4f19-b5dc-adcbcda41402-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:47.369241 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.369210    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls" pod "60d3080b-6e9e-4f19-b5dc-adcbcda41402" (UID: "60d3080b-6e9e-4f19-b5dc-adcbcda41402"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:56:47.369652 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.369631    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs" pod "60d3080b-6e9e-4f19-b5dc-adcbcda41402" (UID: "60d3080b-6e9e-4f19-b5dc-adcbcda41402"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:56:47.369652 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.369640    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844" pod "60d3080b-6e9e-4f19-b5dc-adcbcda41402" (UID: "60d3080b-6e9e-4f19-b5dc-adcbcda41402"). InnerVolumeSpecName "kube-api-access-7f844". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:47.468808 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.468765    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:47.468808 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.468805    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f844\" (UniqueName: \"kubernetes.io/projected/60d3080b-6e9e-4f19-b5dc-adcbcda41402-kube-api-access-7f844\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:47.469021 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.468824    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d3080b-6e9e-4f19-b5dc-adcbcda41402-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:47.774314 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.774268    5925 generic.go:356] "Generic (PLEG): container finished" podID="60d3080b-6e9e-4f19-b5dc-adcbcda41402" containerID="f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2" exitCode=0
Oct 31 00:56:47.774529 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.774320    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"
Oct 31 00:56:47.774529 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.774350    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j" event={"ID":"60d3080b-6e9e-4f19-b5dc-adcbcda41402","Type":"ContainerDied","Data":"f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2"}
Oct 31 00:56:47.774529 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.774409    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j" event={"ID":"60d3080b-6e9e-4f19-b5dc-adcbcda41402","Type":"ContainerDied","Data":"01d3076ff4935653d437df49eb5ae25b364eb3e6a47e2c763ad00e43206ac9eb"}
Oct 31 00:56:47.774529 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.774463    5925 scope.go:122] "RemoveContainer" containerID="f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2"
Oct 31 00:56:47.784875 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.784853    5925 scope.go:122] "RemoveContainer" containerID="f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2"
Oct 31 00:56:47.785119 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:56:47.785097    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2\": container with ID starting with f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2 not found: ID does not exist" containerID="f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2"
Oct 31 00:56:47.785231 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.785130    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2"} err="failed to get container status \"f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2\": rpc error: code = NotFound desc = could not find container \"f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2\": container with ID starting with f09f186441d95c3be6cd7eed7fed084dc70fc03c810b7371561d775f6a371fa2 not found: ID does not exist"
Oct 31 00:56:47.932867 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.932834    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"]
Oct 31 00:56:47.936167 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:47.936142    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-412743-866454db65-rtd6j"]
Oct 31 00:56:48.462437 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:48.462291    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60d3080b-6e9e-4f19-b5dc-adcbcda41402" path="/var/lib/kubelet/pods/60d3080b-6e9e-4f19-b5dc-adcbcda41402/volumes"
Oct 31 00:56:50.097422 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:50.097371    5925 patch_prober.go:29] interesting pod/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:56:50.097825 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:50.097457    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:56:50.796454 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:50.796389    5925 generic.go:356] "Generic (PLEG): container finished" podID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerID="16cb4754573ad3f53f611a8421fd12c167b2f5b10ae2acb86850243c786d1ad0" exitCode=0
Oct 31 00:56:50.796454 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:50.796443    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" event={"ID":"9385b50e-5ba5-454e-bf08-9c77ae52d75f","Type":"ContainerDied","Data":"16cb4754573ad3f53f611a8421fd12c167b2f5b10ae2acb86850243c786d1ad0"}
Oct 31 00:56:50.904422 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:50.904351    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:56:51.010486 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010450    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010604    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010663 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010658    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010664    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:51.010759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010700    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010734    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010917 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010818    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010917 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010847    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.010917 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.010899    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.011082 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011037    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:51.011202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011177    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:51.011274 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011201    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:51.011274 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011262    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert\") pod \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\" (UID: \"9385b50e-5ba5-454e-bf08-9c77ae52d75f\") "
Oct 31 00:56:51.011778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011754    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.011778 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011765    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:56:51.011983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011781    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.011983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011799    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.011983 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.011813    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.013129 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.013101    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:56:51.013234 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.013196    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "kube-api-access-hwdm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:51.013294 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.013271    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:56:51.013347 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.013296    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token" pod "9385b50e-5ba5-454e-bf08-9c77ae52d75f" (UID: "9385b50e-5ba5-454e-bf08-9c77ae52d75f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:56:51.112646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.112607    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.112646 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.112642    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.113109 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.112656    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.113109 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.112675    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9385b50e-5ba5-454e-bf08-9c77ae52d75f-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.113109 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.112688    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwdm4\" (UniqueName: \"kubernetes.io/projected/9385b50e-5ba5-454e-bf08-9c77ae52d75f-kube-api-access-hwdm4\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:56:51.804246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.804211    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5" event={"ID":"9385b50e-5ba5-454e-bf08-9c77ae52d75f","Type":"ContainerDied","Data":"3895235b9c7ba991942b1a47d70e38081cb465c9fb09f44c836e65b7d200aab8"}
Oct 31 00:56:51.804246 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.804234    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"
Oct 31 00:56:51.804527 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:51.804270    5925 scope.go:122] "RemoveContainer" containerID="16cb4754573ad3f53f611a8421fd12c167b2f5b10ae2acb86850243c786d1ad0"
Oct 31 00:56:52.016765 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:52.016721    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"]
Oct 31 00:56:52.065805 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:52.065722    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-101b9e-openshift-default-5bbfdd65d5-ngfr5"]
Oct 31 00:56:52.452879 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:56:52.452846    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" path="/var/lib/kubelet/pods/9385b50e-5ba5-454e-bf08-9c77ae52d75f/volumes"
Oct 31 00:57:16.543690 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:57:16.543609    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:57:46.542325 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:57:46.542289    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:57:59.440339 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:57:59.440298    5925 scope.go:122] "RemoveContainer" containerID="af3879b407804ca778260fdd9980f5fc49e4a20fb0db272fe34ce65fb7c9c2c7"
Oct 31 00:58:16.545570 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:58:16.545514    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:58:46.542721 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:58:46.542685    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:59:15.498702 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.498665    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"]
Oct 31 00:59:15.499137 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.498863    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" podUID="9ff5d215-17c9-42b7-9c9b-d3de426a3464" containerName="maas-api" containerID="cri-o://69d740474abe19b71ebc7e40ae612f04bfd484a8a4561e950da25e1fac186f34" gracePeriod=30
Oct 31 00:59:15.696480 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.696405    5925 generic.go:356] "Generic (PLEG): container finished" podID="9ff5d215-17c9-42b7-9c9b-d3de426a3464" containerID="69d740474abe19b71ebc7e40ae612f04bfd484a8a4561e950da25e1fac186f34" exitCode=0
Oct 31 00:59:15.696637 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.696452    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" event={"ID":"9ff5d215-17c9-42b7-9c9b-d3de426a3464","Type":"ContainerDied","Data":"69d740474abe19b71ebc7e40ae612f04bfd484a8a4561e950da25e1fac186f34"}
Oct 31 00:59:15.766202 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.766138    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:59:15.910596 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.910554    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\") pod \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") "
Oct 31 00:59:15.910837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.910693    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs\") pod \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") "
Oct 31 00:59:15.910837 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.910735    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk\" (UniqueName: \"kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk\") pod \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") "
Oct 31 00:59:15.911007 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.910842    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca\") pod \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\" (UID: \"9ff5d215-17c9-42b7-9c9b-d3de426a3464\") "
Oct 31 00:59:15.911667 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.911640    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca" pod "9ff5d215-17c9-42b7-9c9b-d3de426a3464" (UID: "9ff5d215-17c9-42b7-9c9b-d3de426a3464"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:59:15.915444 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.915384    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs" pod "9ff5d215-17c9-42b7-9c9b-d3de426a3464" (UID: "9ff5d215-17c9-42b7-9c9b-d3de426a3464"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:15.917946 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.917902    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk" pod "9ff5d215-17c9-42b7-9c9b-d3de426a3464" (UID: "9ff5d215-17c9-42b7-9c9b-d3de426a3464"). InnerVolumeSpecName "kube-api-access-b45pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:59:15.920802 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:15.920775    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls" pod "9ff5d215-17c9-42b7-9c9b-d3de426a3464" (UID: "9ff5d215-17c9-42b7-9c9b-d3de426a3464"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:16.012224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.012186    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff5d215-17c9-42b7-9c9b-d3de426a3464-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:16.012224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.012217    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:16.012224 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.012231    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ff5d215-17c9-42b7-9c9b-d3de426a3464-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:16.012500 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.012246    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b45pk\" (UniqueName: \"kubernetes.io/projected/9ff5d215-17c9-42b7-9c9b-d3de426a3464-kube-api-access-b45pk\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:16.541909 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:59:16.541875    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:59:16.703759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.703722    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl" event={"ID":"9ff5d215-17c9-42b7-9c9b-d3de426a3464","Type":"ContainerDied","Data":"a7171210e8023cc7e5c91bae02456bbd5d2225e1b19121edf779f7673af7ca63"}
Oct 31 00:59:16.703759 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.703756    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"
Oct 31 00:59:16.704018 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.703791    5925 scope.go:122] "RemoveContainer" containerID="69d740474abe19b71ebc7e40ae612f04bfd484a8a4561e950da25e1fac186f34"
Oct 31 00:59:16.872146 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.872113    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"]
Oct 31 00:59:16.878060 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:16.878036    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab8e5-7dcd876687-266kl"]
Oct 31 00:59:18.451678 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:18.451644    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ff5d215-17c9-42b7-9c9b-d3de426a3464" path="/var/lib/kubelet/pods/9ff5d215-17c9-42b7-9c9b-d3de426a3464/volumes"
Oct 31 00:59:42.994153 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:42.994117    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"]
Oct 31 00:59:42.994648 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:42.994362    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" podUID="71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" containerName="maas-api" containerID="cri-o://13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec" gracePeriod=30
Oct 31 00:59:43.246097 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.246029    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:59:43.289595 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.289566    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c\" (UniqueName: \"kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c\") pod \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") "
Oct 31 00:59:43.289730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.289702    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs\") pod \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") "
Oct 31 00:59:43.289730 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.289725    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\") pod \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") "
Oct 31 00:59:43.289835 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.289749    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca\") pod \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\" (UID: \"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6\") "
Oct 31 00:59:43.290203 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.290175    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca" pod "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" (UID: "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:59:43.291644 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.291622    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c" pod "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" (UID: "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6"). InnerVolumeSpecName "kube-api-access-kws8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:59:43.291782 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.291763    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls" pod "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" (UID: "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:43.291863 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.291844    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs" pod "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" (UID: "71f9e3c6-ef70-4c32-87bd-f75b5c03cde6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:43.390559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.390521    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kws8c\" (UniqueName: \"kubernetes.io/projected/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-kube-api-access-kws8c\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:43.390559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.390551    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:43.390559 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.390561    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:43.390855 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.390570    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:43.872366 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.872333    5925 generic.go:356] "Generic (PLEG): container finished" podID="71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" containerID="13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec" exitCode=0
Oct 31 00:59:43.872593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.872383    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"
Oct 31 00:59:43.872593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.872407    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" event={"ID":"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6","Type":"ContainerDied","Data":"13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec"}
Oct 31 00:59:43.872593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.872478    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx" event={"ID":"71f9e3c6-ef70-4c32-87bd-f75b5c03cde6","Type":"ContainerDied","Data":"4f87657d720df0206e21f4fc4d7bac83bb64f44609e90284057a6a568b7a99a3"}
Oct 31 00:59:43.872593 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.872505    5925 scope.go:122] "RemoveContainer" containerID="13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec"
Oct 31 00:59:43.883381 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.883364    5925 scope.go:122] "RemoveContainer" containerID="13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec"
Oct 31 00:59:43.883647 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:59:43.883625    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec\": container with ID starting with 13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec not found: ID does not exist" containerID="13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec"
Oct 31 00:59:43.883721 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:43.883656    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec"} err="failed to get container status \"13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec\": rpc error: code = NotFound desc = could not find container \"13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec\": container with ID starting with 13e873247ceed555893411add78f27b9b7fda826efb86b6d2c2c90e21efea7ec not found: ID does not exist"
Oct 31 00:59:44.050755 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:44.050720    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"]
Oct 31 00:59:44.054564 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:44.054541    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-bc2453-76d5bbf774-299hx"]
Oct 31 00:59:44.451988 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:44.451956    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" path="/var/lib/kubelet/pods/71f9e3c6-ef70-4c32-87bd-f75b5c03cde6/volumes"
Oct 31 00:59:46.543401 ip-10-0-140-47 kubenswrapper[5925]: E1031 00:59:46.543348    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 00:59:58.925817 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:58.925782    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 00:59:58.934788 ip-10-0-140-47 kubenswrapper[5925]: I1031 00:59:58.934765    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:00:14.979435 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:14.979347    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"]
Oct 31 01:00:14.979965 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:14.979554    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" podUID="493eb066-3aa0-421a-b24f-a837a3e73add" containerName="maas-api" containerID="cri-o://70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8" gracePeriod=30
Oct 31 01:00:15.244500 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.244439    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 01:00:15.321150 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.321120    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca\") pod \"493eb066-3aa0-421a-b24f-a837a3e73add\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") "
Oct 31 01:00:15.321297 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.321164    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\") pod \"493eb066-3aa0-421a-b24f-a837a3e73add\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") "
Oct 31 01:00:15.321297 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.321232    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x\" (UniqueName: \"kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x\") pod \"493eb066-3aa0-421a-b24f-a837a3e73add\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") "
Oct 31 01:00:15.321297 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.321292    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs\") pod \"493eb066-3aa0-421a-b24f-a837a3e73add\" (UID: \"493eb066-3aa0-421a-b24f-a837a3e73add\") "
Oct 31 01:00:15.321575 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.321540    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca" pod "493eb066-3aa0-421a-b24f-a837a3e73add" (UID: "493eb066-3aa0-421a-b24f-a837a3e73add"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:00:15.323349 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.323324    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs" pod "493eb066-3aa0-421a-b24f-a837a3e73add" (UID: "493eb066-3aa0-421a-b24f-a837a3e73add"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:00:15.323461 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.323362    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls" pod "493eb066-3aa0-421a-b24f-a837a3e73add" (UID: "493eb066-3aa0-421a-b24f-a837a3e73add"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:00:15.323562 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.323543    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x" pod "493eb066-3aa0-421a-b24f-a837a3e73add" (UID: "493eb066-3aa0-421a-b24f-a837a3e73add"). InnerVolumeSpecName "kube-api-access-tbx7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:00:15.423110 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.423073    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbx7x\" (UniqueName: \"kubernetes.io/projected/493eb066-3aa0-421a-b24f-a837a3e73add-kube-api-access-tbx7x\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:15.423110 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.423108    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:15.423320 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.423124    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/493eb066-3aa0-421a-b24f-a837a3e73add-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:15.423320 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:15.423138    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/493eb066-3aa0-421a-b24f-a837a3e73add-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:16.073698 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.073661    5925 generic.go:356] "Generic (PLEG): container finished" podID="493eb066-3aa0-421a-b24f-a837a3e73add" containerID="70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8" exitCode=0
Oct 31 01:00:16.074141 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.073703    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"
Oct 31 01:00:16.074141 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.073743    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" event={"ID":"493eb066-3aa0-421a-b24f-a837a3e73add","Type":"ContainerDied","Data":"70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8"}
Oct 31 01:00:16.074141 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.073792    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w" event={"ID":"493eb066-3aa0-421a-b24f-a837a3e73add","Type":"ContainerDied","Data":"aaa2b66f0f1c9f06d0925e7b5b68c7b5e3bf14187b533e2747a906b8495a9ae1"}
Oct 31 01:00:16.074141 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.073816    5925 scope.go:122] "RemoveContainer" containerID="70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8"
Oct 31 01:00:16.087877 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.087853    5925 scope.go:122] "RemoveContainer" containerID="70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8"
Oct 31 01:00:16.088165 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:00:16.088139    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8\": container with ID starting with 70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8 not found: ID does not exist" containerID="70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8"
Oct 31 01:00:16.088214 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.088178    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8"} err="failed to get container status \"70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8\": rpc error: code = NotFound desc = could not find container \"70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8\": container with ID starting with 70e0d73d4f66aff103723ff4cf9a3f8efc3915f10486ab636de557dcf59c30c8 not found: ID does not exist"
Oct 31 01:00:16.238610 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.238573    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"]
Oct 31 01:00:16.286350 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.286319    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-4b86e4-8cd54466f-n8l8w"]
Oct 31 01:00:16.452624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:16.452589    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="493eb066-3aa0-421a-b24f-a837a3e73add" path="/var/lib/kubelet/pods/493eb066-3aa0-421a-b24f-a837a3e73add/volumes"
Oct 31 01:00:16.544468 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:00:16.544431    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:00:46.541762 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:00:46.541703    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:00:46.703482 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:46.703448    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"]
Oct 31 01:00:46.703655 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:46.703640    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" podUID="6b056407-8ecf-43b3-ae8f-a257ea081b84" containerName="maas-api" containerID="cri-o://3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664" gracePeriod=30
Oct 31 01:00:46.963159 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:46.963128    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 01:00:47.037881 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.037847    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs\") pod \"6b056407-8ecf-43b3-ae8f-a257ea081b84\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") "
Oct 31 01:00:47.038084 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.037934    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\") pod \"6b056407-8ecf-43b3-ae8f-a257ea081b84\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") "
Oct 31 01:00:47.038084 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.037999    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca\") pod \"6b056407-8ecf-43b3-ae8f-a257ea081b84\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") "
Oct 31 01:00:47.038084 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.038053    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6\" (UniqueName: \"kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6\") pod \"6b056407-8ecf-43b3-ae8f-a257ea081b84\" (UID: \"6b056407-8ecf-43b3-ae8f-a257ea081b84\") "
Oct 31 01:00:47.038351 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.038318    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca" pod "6b056407-8ecf-43b3-ae8f-a257ea081b84" (UID: "6b056407-8ecf-43b3-ae8f-a257ea081b84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:00:47.040087 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.040036    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs" pod "6b056407-8ecf-43b3-ae8f-a257ea081b84" (UID: "6b056407-8ecf-43b3-ae8f-a257ea081b84"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:00:47.040199 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.040117    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls" pod "6b056407-8ecf-43b3-ae8f-a257ea081b84" (UID: "6b056407-8ecf-43b3-ae8f-a257ea081b84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:00:47.040199 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.040125    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6" pod "6b056407-8ecf-43b3-ae8f-a257ea081b84" (UID: "6b056407-8ecf-43b3-ae8f-a257ea081b84"). InnerVolumeSpecName "kube-api-access-cpkx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:00:47.139509 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.139473    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:47.139509 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.139503    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b056407-8ecf-43b3-ae8f-a257ea081b84-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:47.139509 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.139513    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b056407-8ecf-43b3-ae8f-a257ea081b84-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:47.139748 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.139522    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpkx6\" (UniqueName: \"kubernetes.io/projected/6b056407-8ecf-43b3-ae8f-a257ea081b84-kube-api-access-cpkx6\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:00:47.255511 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.255472    5925 generic.go:356] "Generic (PLEG): container finished" podID="6b056407-8ecf-43b3-ae8f-a257ea081b84" containerID="3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664" exitCode=0
Oct 31 01:00:47.255679 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.255523    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"
Oct 31 01:00:47.255679 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.255557    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" event={"ID":"6b056407-8ecf-43b3-ae8f-a257ea081b84","Type":"ContainerDied","Data":"3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664"}
Oct 31 01:00:47.255679 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.255635    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w" event={"ID":"6b056407-8ecf-43b3-ae8f-a257ea081b84","Type":"ContainerDied","Data":"31197ce904dc731196d3b04ca088c616394719c3d167961480e46dbcc9ba3a7f"}
Oct 31 01:00:47.255679 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.255660    5925 scope.go:122] "RemoveContainer" containerID="3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664"
Oct 31 01:00:47.266350 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.266330    5925 scope.go:122] "RemoveContainer" containerID="3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664"
Oct 31 01:00:47.266667 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:00:47.266648    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664\": container with ID starting with 3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664 not found: ID does not exist" containerID="3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664"
Oct 31 01:00:47.266734 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.266675    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664"} err="failed to get container status \"3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664\": rpc error: code = NotFound desc = could not find container \"3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664\": container with ID starting with 3cbb503adbbc6ffcf1c61305474f6386a2a84b05531c3b791140c8b853e70664 not found: ID does not exist"
Oct 31 01:00:47.413017 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.412934    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"]
Oct 31 01:00:47.418295 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:47.418265    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-0da668-7d6cbfb46d-f8v5w"]
Oct 31 01:00:48.451796 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:00:48.451759    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b056407-8ecf-43b3-ae8f-a257ea081b84" path="/var/lib/kubelet/pods/6b056407-8ecf-43b3-ae8f-a257ea081b84/volumes"
Oct 31 01:01:16.548127 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:01:16.548085    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:01:32.379564 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:32.379528    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"]
Oct 31 01:01:32.380110 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:32.379728    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" containerID="cri-o://b4b496ff372eef128bc206a63553c70aed72f13c889d967daa1112ea17d77a9c" gracePeriod=30
Oct 31 01:01:32.427170 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:32.427133    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"]
Oct 31 01:01:32.427395 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:32.427346    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy" containerID="cri-o://0c79e6029bd2e9b6ca9ed57b44a03e11896140ed3a4c5a8d9eb4f0c07fb505fb" gracePeriod=30
Oct 31 01:01:34.053051 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:34.053005    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-thjff container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 01:01:34.053463 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:34.053074    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 01:01:37.572920 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.572884    5925 generic.go:356] "Generic (PLEG): container finished" podID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerID="0c79e6029bd2e9b6ca9ed57b44a03e11896140ed3a4c5a8d9eb4f0c07fb505fb" exitCode=0
Oct 31 01:01:37.573288 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.572946    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" event={"ID":"1d77ab2e-c75c-4402-a128-0e068068f4c6","Type":"ContainerDied","Data":"0c79e6029bd2e9b6ca9ed57b44a03e11896140ed3a4c5a8d9eb4f0c07fb505fb"}
Oct 31 01:01:37.574747 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.574727    5925 generic.go:356] "Generic (PLEG): container finished" podID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerID="b4b496ff372eef128bc206a63553c70aed72f13c889d967daa1112ea17d77a9c" exitCode=0
Oct 31 01:01:37.574802 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.574758    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" event={"ID":"358a8571-71e1-4caf-9dbc-7988c567eff6","Type":"ContainerDied","Data":"b4b496ff372eef128bc206a63553c70aed72f13c889d967daa1112ea17d77a9c"}
Oct 31 01:01:37.688097 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.688070    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 01:01:37.712034 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.712011    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 01:01:37.845097 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845067    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845105    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845142    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845180    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845206    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845240    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845294    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845362 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845339    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845368    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845402    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845460    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845492    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845518    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845536    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845572    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845603    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845631    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy\") pod \"1d77ab2e-c75c-4402-a128-0e068068f4c6\" (UID: \"1d77ab2e-c75c-4402-a128-0e068068f4c6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845659    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845674    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845689    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845689    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.845783 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845725    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket\") pod \"358a8571-71e1-4caf-9dbc-7988c567eff6\" (UID: \"358a8571-71e1-4caf-9dbc-7988c567eff6\") "
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.845791    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846110    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846166    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846186    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846201    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/358a8571-71e1-4caf-9dbc-7988c567eff6-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846216    5925 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-credential-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846230    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846340    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.846521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846481    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.846991 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846533    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.846991 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.846655    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.847972 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.847935    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:37.848175 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.848152    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.848435 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.848394    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "kube-api-access-lpbld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:37.848531 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.848475    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "kube-api-access-drffb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:37.848698 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.848660    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:01:37.848698 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.848660    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token" pod "358a8571-71e1-4caf-9dbc-7988c567eff6" (UID: "358a8571-71e1-4caf-9dbc-7988c567eff6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:37.848868 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.848734    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:01:37.849034 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.849020    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo" pod "1d77ab2e-c75c-4402-a128-0e068068f4c6" (UID: "1d77ab2e-c75c-4402-a128-0e068068f4c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947176    5925 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-data\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947203    5925 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-socket\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947213    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpbld\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-kube-api-access-lpbld\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947224    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947235    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drffb\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-kube-api-access-drffb\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947243    5925 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d77ab2e-c75c-4402-a128-0e068068f4c6-istiod-ca-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947248 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947251    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947259    5925 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-token\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947267    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947275    5925 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-podinfo\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947283    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/358a8571-71e1-4caf-9dbc-7988c567eff6-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947291    5925 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-workload-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:37.947624 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:37.947299    5925 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d77ab2e-c75c-4402-a128-0e068068f4c6-istio-envoy\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:38.581607 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.581571    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"
Oct 31 01:01:38.582119 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.581571    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff" event={"ID":"358a8571-71e1-4caf-9dbc-7988c567eff6","Type":"ContainerDied","Data":"aaa6244e744722d673e6007995c1314ce84f42f1e1e0dd26fb253f24ad5599cf"}
Oct 31 01:01:38.582119 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.581727    5925 scope.go:122] "RemoveContainer" containerID="b4b496ff372eef128bc206a63553c70aed72f13c889d967daa1112ea17d77a9c"
Oct 31 01:01:38.583250 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.583057    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"
Oct 31 01:01:38.583250 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.583089    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp" event={"ID":"1d77ab2e-c75c-4402-a128-0e068068f4c6","Type":"ContainerDied","Data":"bdad2e2c61751325b0ecfb58b54a0cd137ed620a57b28e734b322799036d4ce0"}
Oct 31 01:01:38.591460 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.591439    5925 scope.go:122] "RemoveContainer" containerID="0c79e6029bd2e9b6ca9ed57b44a03e11896140ed3a4c5a8d9eb4f0c07fb505fb"
Oct 31 01:01:38.790435 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.790327    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"]
Oct 31 01:01:38.834845 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.834809    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-thjff"]
Oct 31 01:01:38.894669 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.894633    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"]
Oct 31 01:01:38.898700 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:38.898671    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-9nrmp"]
Oct 31 01:01:40.451540 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:40.451507    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" path="/var/lib/kubelet/pods/1d77ab2e-c75c-4402-a128-0e068068f4c6/volumes"
Oct 31 01:01:40.451957 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:40.451943    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" path="/var/lib/kubelet/pods/358a8571-71e1-4caf-9dbc-7988c567eff6/volumes"
Oct 31 01:01:45.198645 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.198607    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-9kbkd"]
Oct 31 01:01:45.199074 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.198841    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager" containerID="cri-o://b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb" gracePeriod=30
Oct 31 01:01:45.454876 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.454820    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 01:01:45.519393 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.519363    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs\") pod \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") "
Oct 31 01:01:45.519560 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.519408    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk\" (UniqueName: \"kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk\") pod \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") "
Oct 31 01:01:45.519560 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.519482    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert\") pod \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\" (UID: \"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c\") "
Oct 31 01:01:45.521711 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.521685    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk" pod "2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" (UID: "2f0a7eda-d7cb-4931-b807-a9bc2693cb2c"). InnerVolumeSpecName "kube-api-access-m7xvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:45.521711 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.521701    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs" pod "2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" (UID: "2f0a7eda-d7cb-4931-b807-a9bc2693cb2c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:45.521711 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.521683    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert" pod "2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" (UID: "2f0a7eda-d7cb-4931-b807-a9bc2693cb2c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:45.623592 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.623542    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:45.623592 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.623587    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7xvk\" (UniqueName: \"kubernetes.io/projected/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-kube-api-access-m7xvk\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:45.623806 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.623610    5925 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c-webhook-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:45.628999 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.628967    5925 generic.go:356] "Generic (PLEG): container finished" podID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerID="b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb" exitCode=0
Oct 31 01:01:45.629153 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.629011    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-9kbkd"
Oct 31 01:01:45.629153 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.629049    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" event={"ID":"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c","Type":"ContainerDied","Data":"b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb"}
Oct 31 01:01:45.629153 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.629113    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-9kbkd" event={"ID":"2f0a7eda-d7cb-4931-b807-a9bc2693cb2c","Type":"ContainerDied","Data":"a48dc2134dcf45537e76c58ce50fa4d72089411cbbda603486dfefdb7761c207"}
Oct 31 01:01:45.629153 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.629142    5925 scope.go:122] "RemoveContainer" containerID="b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb"
Oct 31 01:01:45.640736 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.640716    5925 scope.go:122] "RemoveContainer" containerID="876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"
Oct 31 01:01:45.649338 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.649317    5925 scope.go:122] "RemoveContainer" containerID="b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb"
Oct 31 01:01:45.649643 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:01:45.649621    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb\": container with ID starting with b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb not found: ID does not exist" containerID="b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb"
Oct 31 01:01:45.649727 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.649656    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb"} err="failed to get container status \"b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb\": rpc error: code = NotFound desc = could not find container \"b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb\": container with ID starting with b5001e412a3b959c3239fb747cb5a716cf559abff3c977d37d2c8e6268721acb not found: ID does not exist"
Oct 31 01:01:45.649727 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.649684    5925 scope.go:122] "RemoveContainer" containerID="876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"
Oct 31 01:01:45.649935 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:01:45.649917    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467\": container with ID starting with 876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467 not found: ID does not exist" containerID="876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"
Oct 31 01:01:45.649974 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.649942    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467"} err="failed to get container status \"876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467\": rpc error: code = NotFound desc = could not find container \"876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467\": container with ID starting with 876c56677882bd88c52728d09d82b4cb0bcaa1e857b31c7bb14d1eb3cf766467 not found: ID does not exist"
Oct 31 01:01:45.787344 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.787266    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-9kbkd"]
Oct 31 01:01:45.791127 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:45.791101    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-9kbkd"]
Oct 31 01:01:46.451521 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.451489    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" path="/var/lib/kubelet/pods/2f0a7eda-d7cb-4931-b807-a9bc2693cb2c/volumes"
Oct 31 01:01:46.543912 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:01:46.543879    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:01:46.642626 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.642595    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d56c449c7-25cmk"]
Oct 31 01:01:46.643020 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643008    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy"
Oct 31 01:01:46.643065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643021    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy"
Oct 31 01:01:46.643065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643036    5925 cpu_manager.go:414] "containerMap: removing container" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy"
Oct 31 01:01:46.643065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643041    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy"
Oct 31 01:01:46.643065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643055    5925 cpu_manager.go:414] "containerMap: removing container" podUID="493eb066-3aa0-421a-b24f-a837a3e73add" containerName="maas-api"
Oct 31 01:01:46.643065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643060    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="493eb066-3aa0-421a-b24f-a837a3e73add" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643067    5925 cpu_manager.go:414] "containerMap: removing container" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643071    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643079    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643084    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643090    5925 cpu_manager.go:414] "containerMap: removing container" podUID="6b056407-8ecf-43b3-ae8f-a257ea081b84" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643095    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b056407-8ecf-43b3-ae8f-a257ea081b84" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643104    5925 cpu_manager.go:414] "containerMap: removing container" podUID="cdffdf92-1a6e-4f0e-8046-a8459e04262c" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643109    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cdffdf92-1a6e-4f0e-8046-a8459e04262c" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643115    5925 cpu_manager.go:414] "containerMap: removing container" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643120    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643126    5925 cpu_manager.go:414] "containerMap: removing container" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643131    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643138    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643142    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643151    5925 cpu_manager.go:414] "containerMap: removing container" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643156    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643165    5925 cpu_manager.go:414] "containerMap: removing container" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643169    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643181    5925 cpu_manager.go:414] "containerMap: removing container" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643186    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643194    5925 cpu_manager.go:414] "containerMap: removing container" podUID="b942fc86-881c-413d-87a7-b33d47978233" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643198    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b942fc86-881c-413d-87a7-b33d47978233" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643204    5925 cpu_manager.go:414] "containerMap: removing container" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643209    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643215    5925 cpu_manager.go:414] "containerMap: removing container" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643220    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643225    5925 cpu_manager.go:414] "containerMap: removing container" podUID="9ff5d215-17c9-42b7-9c9b-d3de426a3464" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643229    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ff5d215-17c9-42b7-9c9b-d3de426a3464" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643235    5925 cpu_manager.go:414] "containerMap: removing container" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643239    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643245    5925 cpu_manager.go:414] "containerMap: removing container" podUID="60d3080b-6e9e-4f19-b5dc-adcbcda41402" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643249    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60d3080b-6e9e-4f19-b5dc-adcbcda41402" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643255    5925 cpu_manager.go:414] "containerMap: removing container" podUID="71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643259    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" containerName="maas-api"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643265    5925 cpu_manager.go:414] "containerMap: removing container" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery"
Oct 31 01:01:46.643249 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643270    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643277    5925 cpu_manager.go:414] "containerMap: removing container" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643282    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643293    5925 cpu_manager.go:414] "containerMap: removing container" podUID="a25fa42d-95af-49ba-be70-bc778c833e0e" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643299    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a25fa42d-95af-49ba-be70-bc778c833e0e" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643307    5925 cpu_manager.go:414] "containerMap: removing container" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643321    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643327    5925 cpu_manager.go:414] "containerMap: removing container" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643331    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643396    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="cdffdf92-1a6e-4f0e-8046-a8459e04262c" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643405    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="4bb05242-7d96-400b-a491-2bf321c2d625" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643426    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="13f5d606-d28a-41e7-88ea-28d00d92f286" containerName="main"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643436    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7f279b8-7f43-42cc-81fb-ed4dad1e5428" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643445    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d77ab2e-c75c-4402-a128-0e068068f4c6" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643452    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643459    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="125105e1-e44b-49f1-81df-b6bfa16d1602" containerName="main"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643464    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="b942fc86-881c-413d-87a7-b33d47978233" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643469    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="358a8571-71e1-4caf-9dbc-7988c567eff6" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643473    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643478    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ff5d215-17c9-42b7-9c9b-d3de426a3464" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643483    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643488    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="60d3080b-6e9e-4f19-b5dc-adcbcda41402" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643493    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="71f9e3c6-ef70-4c32-87bd-f75b5c03cde6" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643499    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="8534c332-459c-4aa9-bdb0-f329a6463f7e" containerName="discovery"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643505    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f0a7eda-d7cb-4931-b807-a9bc2693cb2c" containerName="manager"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643511    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="a25fa42d-95af-49ba-be70-bc778c833e0e" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643517    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="c37aa8b1-450e-4dfd-965e-29b11ccaad9c" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643522    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="9385b50e-5ba5-454e-bf08-9c77ae52d75f" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643526    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad041db5-19f1-4bf7-8bac-917af1adebea" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643532    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2c046db-5996-4ed9-bb09-d52ea6d80057" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643537    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="493eb066-3aa0-421a-b24f-a837a3e73add" containerName="maas-api"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643543    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="396874bf-c0a1-478b-9d1b-8e31e660a0d1" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643549    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0a77f69-6b1d-4fbf-860e-c3dfa8455e2f" containerName="istio-proxy"
Oct 31 01:01:46.644741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.643553    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b056407-8ecf-43b3-ae8f-a257ea081b84" containerName="maas-api"
Oct 31 01:01:46.648275 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.648258    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.698970 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.698943    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 01:01:46.735056 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.734978    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzkvg\" (UniqueName: \"kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.735056 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.735019    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.735239 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.735130    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.746365 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.746339    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q6rb4\""
Oct 31 01:01:46.746365 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.746341    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 01:01:46.746531 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.746362    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 01:01:46.748621 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.748603    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-25cmk"]
Oct 31 01:01:46.836717 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.836683    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzkvg\" (UniqueName: \"kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.836904 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.836730    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.836904 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.836776    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.839196 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.839167    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.839343 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.839321    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.895665 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.895639    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzkvg\" (UniqueName: \"kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg\") pod \"maas-controller-6d56c449c7-25cmk\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") " pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:46.960840 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:46.960815    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:47.335973 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:47.335938    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-25cmk"]
Oct 31 01:01:47.341986 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:01:47.341962    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645160f4_d0b0_476e_a559_68b31a3035d2.slice/crio-3ea1bab06e771e7d615a5d2c818ffdfcbe14e9bbde5823b57dcd120f0922637d WatchSource:0}: Error finding container 3ea1bab06e771e7d615a5d2c818ffdfcbe14e9bbde5823b57dcd120f0922637d: Status 404 returned error can't find the container with id 3ea1bab06e771e7d615a5d2c818ffdfcbe14e9bbde5823b57dcd120f0922637d
Oct 31 01:01:47.343231 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:47.343213    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 01:01:47.642989 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:47.642901    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-25cmk" event={"ID":"645160f4-d0b0-476e-a559-68b31a3035d2","Type":"ContainerStarted","Data":"3ea1bab06e771e7d615a5d2c818ffdfcbe14e9bbde5823b57dcd120f0922637d"}
Oct 31 01:01:48.649925 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:48.649833    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-25cmk" event={"ID":"645160f4-d0b0-476e-a559-68b31a3035d2","Type":"ContainerStarted","Data":"b26886836ca174dd087168725420f8e5433369c957591cd61a5723b46851a9a6"}
Oct 31 01:01:48.649925 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:48.649916    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:01:48.774752 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:48.774698    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6d56c449c7-25cmk" podStartSLOduration=1.7381027740000001 podStartE2EDuration="2.774683478s" totalImagesPullingTime="1.036580704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:01:48.773063142 +0000 UTC m=+2810.461943089" watchObservedRunningTime="2026-10-31 01:01:48.774683478 +0000 UTC m=+2810.463563422"
Oct 31 01:01:59.659972 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:01:59.659943    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:02:02.642522 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.642486    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"]
Oct 31 01:02:02.647757 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.647733    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.749502 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.749462    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"]
Oct 31 01:02:02.790406 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790373    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790619 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790441    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790619 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790539    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790619 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790597    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790793 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790709    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790793 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790768    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxqlf\" (UniqueName: \"kubernetes.io/projected/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-kube-api-access-fxqlf\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790898 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790852    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790898 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790880    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.790977 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.790940    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892108 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892074    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892108 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892110    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892134    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892153    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892177    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892205    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892246    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892289    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892355 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892334    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxqlf\" (UniqueName: \"kubernetes.io/projected/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-kube-api-access-fxqlf\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892824 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892595    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892824 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892612    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892824 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892794    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.892994 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.892860    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.893075 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.893051    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.894719 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.894691    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.894925 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.894908    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.951107 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.951072    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.951257 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.951195    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxqlf\" (UniqueName: \"kubernetes.io/projected/d1dcda1c-caa1-454f-aed7-aa6f79a0da0e-kube-api-access-fxqlf\") pod \"maas-default-gateway-openshift-default-6886b96f9-qfcgh\" (UID: \"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:02.960908 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:02.960884    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:03.391816 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.391781    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"]
Oct 31 01:02:03.398637 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:02:03.398608    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1dcda1c_caa1_454f_aed7_aa6f79a0da0e.slice/crio-06742804083cba424ad141bda04d24aed041bc9a55b9f9baa6e523f47fa3e33f WatchSource:0}: Error finding container 06742804083cba424ad141bda04d24aed041bc9a55b9f9baa6e523f47fa3e33f: Status 404 returned error can't find the container with id 06742804083cba424ad141bda04d24aed041bc9a55b9f9baa6e523f47fa3e33f
Oct 31 01:02:03.400818 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.400786    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 01:02:03.400886 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.400853    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 01:02:03.400886 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.400880    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 01:02:03.737664 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.737576    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" event={"ID":"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e","Type":"ContainerStarted","Data":"89d8bc30488cb424dc23657c9168b45604294497c669617d1e52f3d806ab48a0"}
Oct 31 01:02:03.737664 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.737641    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" event={"ID":"d1dcda1c-caa1-454f-aed7-aa6f79a0da0e","Type":"ContainerStarted","Data":"06742804083cba424ad141bda04d24aed041bc9a55b9f9baa6e523f47fa3e33f"}
Oct 31 01:02:03.861013 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.860938    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podStartSLOduration=1.860916182 podStartE2EDuration="1.860916182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:02:03.859233402 +0000 UTC m=+2825.548113350" watchObservedRunningTime="2026-10-31 01:02:03.860916182 +0000 UTC m=+2825.549796129"
Oct 31 01:02:03.964570 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:03.964527    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:04.964592 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:04.964521    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:04.965145 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:04.964605    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:05.962438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:05.961861    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:05.962438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:05.961926    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:06.962438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:06.961815    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:06.962438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:06.961880    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:07.964896 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:07.964852    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:07.965510 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:07.964942    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:08.964966 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:08.964912    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:08.965526 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:08.964991    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:09.962048 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:09.962013    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:09.962234 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:09.962081    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:10.961592 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:10.961554    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused" start-of-body=
Oct 31 01:02:10.962111 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:10.961606    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": dial tcp 10.132.0.130:15021: connect: connection refused"
Oct 31 01:02:11.965497 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:11.965462    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:11.965881 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:11.965827    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:11.966549 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:11.966528    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh"
Oct 31 01:02:16.544438 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:02:16.544389    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:02:20.620474 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.620438    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-25cmk"]
Oct 31 01:02:20.620997 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.620661    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-6d56c449c7-25cmk" podUID="645160f4-d0b0-476e-a559-68b31a3035d2" containerName="manager" containerID="cri-o://b26886836ca174dd087168725420f8e5433369c957591cd61a5723b46851a9a6" gracePeriod=30
Oct 31 01:02:20.860482 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.860447    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-25cmk" event={"ID":"645160f4-d0b0-476e-a559-68b31a3035d2","Type":"ContainerDied","Data":"b26886836ca174dd087168725420f8e5433369c957591cd61a5723b46851a9a6"}
Oct 31 01:02:20.860622 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.860461    5925 generic.go:356] "Generic (PLEG): container finished" podID="645160f4-d0b0-476e-a559-68b31a3035d2" containerID="b26886836ca174dd087168725420f8e5433369c957591cd61a5723b46851a9a6" exitCode=0
Oct 31 01:02:20.882062 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.882000    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:02:20.899240 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.899210    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert\") pod \"645160f4-d0b0-476e-a559-68b31a3035d2\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") "
Oct 31 01:02:20.899431 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.899404    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg\" (UniqueName: \"kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg\") pod \"645160f4-d0b0-476e-a559-68b31a3035d2\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") "
Oct 31 01:02:20.899496 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.899482    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs\") pod \"645160f4-d0b0-476e-a559-68b31a3035d2\" (UID: \"645160f4-d0b0-476e-a559-68b31a3035d2\") "
Oct 31 01:02:20.901361 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.901328    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert" pod "645160f4-d0b0-476e-a559-68b31a3035d2" (UID: "645160f4-d0b0-476e-a559-68b31a3035d2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:02:20.901516 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.901498    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg" pod "645160f4-d0b0-476e-a559-68b31a3035d2" (UID: "645160f4-d0b0-476e-a559-68b31a3035d2"). InnerVolumeSpecName "kube-api-access-bzkvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:02:20.901563 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:20.901521    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs" pod "645160f4-d0b0-476e-a559-68b31a3035d2" (UID: "645160f4-d0b0-476e-a559-68b31a3035d2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:02:21.001140 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:21.001100    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzkvg\" (UniqueName: \"kubernetes.io/projected/645160f4-d0b0-476e-a559-68b31a3035d2-kube-api-access-bzkvg\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:02:21.001140 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:21.001141    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:02:21.001346 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:21.001157    5925 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/645160f4-d0b0-476e-a559-68b31a3035d2-webhook-cert\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:02:21.868008 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:21.867974    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-25cmk"
Oct 31 01:02:21.868540 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:21.868014    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-25cmk" event={"ID":"645160f4-d0b0-476e-a559-68b31a3035d2","Type":"ContainerDied","Data":"3ea1bab06e771e7d615a5d2c818ffdfcbe14e9bbde5823b57dcd120f0922637d"}
Oct 31 01:02:21.868540 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:21.868083    5925 scope.go:122] "RemoveContainer" containerID="b26886836ca174dd087168725420f8e5433369c957591cd61a5723b46851a9a6"
Oct 31 01:02:22.026384 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:22.026352    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-25cmk"]
Oct 31 01:02:22.073858 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:22.073821    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-25cmk"]
Oct 31 01:02:22.451168 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:22.451136    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="645160f4-d0b0-476e-a559-68b31a3035d2" path="/var/lib/kubelet/pods/645160f4-d0b0-476e-a559-68b31a3035d2/volumes"
Oct 31 01:02:23.506548 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.506509    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d56c449c7-vhgvt"]
Oct 31 01:02:23.507052 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.506976    5925 cpu_manager.go:414] "containerMap: removing container" podUID="645160f4-d0b0-476e-a559-68b31a3035d2" containerName="manager"
Oct 31 01:02:23.507052 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.506988    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="645160f4-d0b0-476e-a559-68b31a3035d2" containerName="manager"
Oct 31 01:02:23.507137 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.507087    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="645160f4-d0b0-476e-a559-68b31a3035d2" containerName="manager"
Oct 31 01:02:23.510322 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.510300    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.609406 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.609366    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 01:02:23.609622 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.609499    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 01:02:23.609700 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.609628    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 01:02:23.609759 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.609719    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q6rb4\""
Oct 31 01:02:23.611748 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.611717    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-vhgvt"]
Oct 31 01:02:23.628803 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.628771    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2ee7ba7-d231-4ac9-874d-6be9149040f0-webhook-cert\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.628977 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.628815    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ee7ba7-d231-4ac9-874d-6be9149040f0-metrics-certs\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.628977 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.628840    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xxp\" (UniqueName: \"kubernetes.io/projected/b2ee7ba7-d231-4ac9-874d-6be9149040f0-kube-api-access-z7xxp\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.729920 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.729875    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ee7ba7-d231-4ac9-874d-6be9149040f0-metrics-certs\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.729920 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.729923    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xxp\" (UniqueName: \"kubernetes.io/projected/b2ee7ba7-d231-4ac9-874d-6be9149040f0-kube-api-access-z7xxp\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.730207 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.730018    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2ee7ba7-d231-4ac9-874d-6be9149040f0-webhook-cert\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.732503 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.732476    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2ee7ba7-d231-4ac9-874d-6be9149040f0-webhook-cert\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.732635 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.732545    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2ee7ba7-d231-4ac9-874d-6be9149040f0-metrics-certs\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.789552 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.789473    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xxp\" (UniqueName: \"kubernetes.io/projected/b2ee7ba7-d231-4ac9-874d-6be9149040f0-kube-api-access-z7xxp\") pod \"maas-controller-6d56c449c7-vhgvt\" (UID: \"b2ee7ba7-d231-4ac9-874d-6be9149040f0\") " pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:23.823912 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:23.823874    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:24.198728 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:24.198690    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d56c449c7-vhgvt"]
Oct 31 01:02:24.205221 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:02:24.205192    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ee7ba7_d231_4ac9_874d_6be9149040f0.slice/crio-41b81badf0440136c3767a0049d9fd029c5ec32803322d4a7f59deddd0e3e8b9 WatchSource:0}: Error finding container 41b81badf0440136c3767a0049d9fd029c5ec32803322d4a7f59deddd0e3e8b9: Status 404 returned error can't find the container with id 41b81badf0440136c3767a0049d9fd029c5ec32803322d4a7f59deddd0e3e8b9
Oct 31 01:02:24.891744 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:24.891707    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-vhgvt" event={"ID":"b2ee7ba7-d231-4ac9-874d-6be9149040f0","Type":"ContainerStarted","Data":"41b81badf0440136c3767a0049d9fd029c5ec32803322d4a7f59deddd0e3e8b9"}
Oct 31 01:02:25.901594 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:25.901554    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d56c449c7-vhgvt" event={"ID":"b2ee7ba7-d231-4ac9-874d-6be9149040f0","Type":"ContainerStarted","Data":"01f81e9ff8ae5c34d21e7a62af30b08883378e0c73c3241520dc6cc1a52aa03e"}
Oct 31 01:02:25.902055 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:25.901642    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:26.014374 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:26.014321    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-6d56c449c7-vhgvt" podStartSLOduration=1.892337202 podStartE2EDuration="3.014306743s" totalImagesPullingTime="1.121969541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:02:26.013835717 +0000 UTC m=+2847.702715668" watchObservedRunningTime="2026-10-31 01:02:26.014306743 +0000 UTC m=+2847.703186688"
Oct 31 01:02:36.911632 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:02:36.911593    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d56c449c7-vhgvt"
Oct 31 01:02:46.543202 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:02:46.543160    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:03:16.542831 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:03:16.542746    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:03:33.340013 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.339979    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"]
Oct 31 01:03:33.344024 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.344000    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.440829 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.440798    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"]
Oct 31 01:03:33.495188 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495150    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495367 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495208    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495367 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495258    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495487 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495377    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495487 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495433    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495487 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495481    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495605 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495514    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbdpz\" (UniqueName: \"kubernetes.io/projected/c7823783-3b3c-425f-bbf2-662f16cb2a91-kube-api-access-sbdpz\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495605 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495571    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.495605 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.495602    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7823783-3b3c-425f-bbf2-662f16cb2a91-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596216 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596132    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596216 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596171    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596489 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596302    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbdpz\" (UniqueName: \"kubernetes.io/projected/c7823783-3b3c-425f-bbf2-662f16cb2a91-kube-api-access-sbdpz\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596489 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596369    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596489 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596407    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7823783-3b3c-425f-bbf2-662f16cb2a91-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596655 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596498    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596655 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596531    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596655 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596555    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596655 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596610    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596655 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596637    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596929 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596695    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596987 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596929    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.596987 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.596962    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.597273 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.597250    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7823783-3b3c-425f-bbf2-662f16cb2a91-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.599070 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.599049    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.599169 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.599076    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.655206 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.655183    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7823783-3b3c-425f-bbf2-662f16cb2a91-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.655455 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.655402    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbdpz\" (UniqueName: \"kubernetes.io/projected/c7823783-3b3c-425f-bbf2-662f16cb2a91-kube-api-access-sbdpz\") pod \"maas-default-gateway-openshift-default-6886b96f9-vxqbg\" (UID: \"c7823783-3b3c-425f-bbf2-662f16cb2a91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:33.657051 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:33.657029    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:34.095858 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.095823    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"]
Oct 31 01:03:34.100367 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:03:34.100341    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7823783_3b3c_425f_bbf2_662f16cb2a91.slice/crio-548658cc629edae634d6ef2a91a6cfe9890c2621460199cacd0e180b6bb964e0 WatchSource:0}: Error finding container 548658cc629edae634d6ef2a91a6cfe9890c2621460199cacd0e180b6bb964e0: Status 404 returned error can't find the container with id 548658cc629edae634d6ef2a91a6cfe9890c2621460199cacd0e180b6bb964e0
Oct 31 01:03:34.102453 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.102401    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 01:03:34.102556 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.102499    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 01:03:34.102556 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.102545    5925 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 01:03:34.304886 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.304847    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" event={"ID":"c7823783-3b3c-425f-bbf2-662f16cb2a91","Type":"ContainerStarted","Data":"74b2888bee29d01cbf6a2b18759f890919de7f130c185b4c5fa1af51820ae989"}
Oct 31 01:03:34.305082 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.304910    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" event={"ID":"c7823783-3b3c-425f-bbf2-662f16cb2a91","Type":"ContainerStarted","Data":"548658cc629edae634d6ef2a91a6cfe9890c2621460199cacd0e180b6bb964e0"}
Oct 31 01:03:34.422246 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.422142    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podStartSLOduration=1.422123278 podStartE2EDuration="1.422123278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:03:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:03:34.420547596 +0000 UTC m=+2916.109427543" watchObservedRunningTime="2026-10-31 01:03:34.422123278 +0000 UTC m=+2916.111003226"
Oct 31 01:03:34.661437 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:34.657086    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:35.663438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:35.661537    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:35.663438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:35.661623    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:36.661437 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:36.657982    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:36.661437 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:36.658062    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:37.659438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:37.658909    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:37.659438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:37.658994    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:38.660441 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:38.659841    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:38.660441 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:38.659925    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:39.659894 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:39.659854    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:39.660221 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:39.660186    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:40.657710 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:40.657667    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:40.658107 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:40.657754    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:41.657665 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:41.657631    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused" start-of-body=
Oct 31 01:03:41.657859 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:41.657696    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": dial tcp 10.132.0.132:15021: connect: connection refused"
Oct 31 01:03:43.698586 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:43.698549    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-vxqbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.132:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 01:03:43.699137 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:43.698605    5925 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg" podUID="c7823783-3b3c-425f-bbf2-662f16cb2a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.132:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 01:03:44.477824 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:44.477786    5925 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:44.478602 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:44.478572    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:44.479171 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:03:44.479152    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-vxqbg"
Oct 31 01:03:46.544176 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:03:46.544141    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:04:16.542302 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:04:16.542261    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:04:46.542403 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:04:46.542363    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:04:58.968642 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:04:58.968614    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:04:58.975859 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:04:58.975836    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:05:16.546906 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:05:16.546860    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:05:46.542895 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:05:46.542846    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:06:16.544336 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:06:16.544257    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:06:46.542078 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:06:46.542034    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:07:13.010641 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:07:13.010598    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 01:07:13.011807 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:07:13.011753    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 01:07:16.544307 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:07:16.544266    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:07:46.544642 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:07:46.544601    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:08:16.542699 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:08:16.542657    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:08:46.541902 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:08:46.541859    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:09:16.544182 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:09:16.544103    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:09:27.206906 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.206870    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"]
Oct 31 01:09:27.210622 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.210600    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.300382 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.300345    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.300585 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.300405    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwl44\" (UniqueName: \"kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.300673 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.300596    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.300673 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.300647    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.310525 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.310498    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-863fb0-serving-cert\""
Oct 31 01:09:27.312839 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.312817    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"]
Oct 31 01:09:27.401354 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.401314    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.401554 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.401360    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.401554 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.401442    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.401554 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.401482    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwl44\" (UniqueName: \"kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.401554 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:09:27.401537    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-serving-cert: secret "maas-api-e2e-worker-single-main-863fb0-serving-cert" not found
Oct 31 01:09:27.401777 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:09:27.401596    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls podName:774786ea-68fe-4aa5-b074-051094b8bff4 nodeName:}" failed. No retries permitted until 2026-10-31 01:09:27.901581031 +0000 UTC m=+3269.590460958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls") pod "maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" (UID: "774786ea-68fe-4aa5-b074-051094b8bff4") : secret "maas-api-e2e-worker-single-main-863fb0-serving-cert" not found
Oct 31 01:09:27.402040 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.402020    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.403819 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.403802    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.462830 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.462748    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwl44\" (UniqueName: \"kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.907585 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.907549    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:27.909998 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:27.909971    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:28.123865 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:28.123831    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:28.496680 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:28.496598    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"]
Oct 31 01:09:28.502638 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:09:28.502610    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774786ea_68fe_4aa5_b074_051094b8bff4.slice/crio-20c78db7a239c3ee271b9c7c97ae9c58a8e245a72dfd15a46bdf236b9fa28fbe WatchSource:0}: Error finding container 20c78db7a239c3ee271b9c7c97ae9c58a8e245a72dfd15a46bdf236b9fa28fbe: Status 404 returned error can't find the container with id 20c78db7a239c3ee271b9c7c97ae9c58a8e245a72dfd15a46bdf236b9fa28fbe
Oct 31 01:09:28.503958 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:28.503940    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 01:09:28.775172 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:28.775094    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" event={"ID":"774786ea-68fe-4aa5-b074-051094b8bff4","Type":"ContainerStarted","Data":"20c78db7a239c3ee271b9c7c97ae9c58a8e245a72dfd15a46bdf236b9fa28fbe"}
Oct 31 01:09:29.781739 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:29.781648    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" event={"ID":"774786ea-68fe-4aa5-b074-051094b8bff4","Type":"ContainerStarted","Data":"92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9"}
Oct 31 01:09:29.782092 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:29.781736    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:29.909705 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:29.909656    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" podStartSLOduration=1.915033625 podStartE2EDuration="2.90964186s" totalImagesPullingTime="994.608235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:09:29.907801956 +0000 UTC m=+3271.596681912" watchObservedRunningTime="2026-10-31 01:09:29.90964186 +0000 UTC m=+3271.598521803"
Oct 31 01:09:35.793359 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:35.793325    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:09:46.541153 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:09:46.541114    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:09:59.007579 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:59.007547    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:09:59.018495 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:09:59.018472    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:10:16.541275 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:10:16.541241    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:10:46.542383 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:10:46.542348    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:10:59.692633 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:10:59.692592    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"]
Oct 31 01:10:59.693218 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:10:59.692920    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" podUID="774786ea-68fe-4aa5-b074-051094b8bff4" containerName="maas-api" containerID="cri-o://92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9" gracePeriod=30
Oct 31 01:11:00.788440 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:00.788367    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" podUID="774786ea-68fe-4aa5-b074-051094b8bff4" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.133:8443/health\": dial tcp 10.132.0.133:8443: connect: connection refused"
Oct 31 01:11:00.945949 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:00.945922    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:11:01.047438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.047326    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44\" (UniqueName: \"kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44\") pod \"774786ea-68fe-4aa5-b074-051094b8bff4\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") "
Oct 31 01:11:01.047615 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.047453    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca\") pod \"774786ea-68fe-4aa5-b074-051094b8bff4\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") "
Oct 31 01:11:01.047615 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.047479    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs\") pod \"774786ea-68fe-4aa5-b074-051094b8bff4\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") "
Oct 31 01:11:01.047615 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.047548    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\") pod \"774786ea-68fe-4aa5-b074-051094b8bff4\" (UID: \"774786ea-68fe-4aa5-b074-051094b8bff4\") "
Oct 31 01:11:01.047883 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.047854    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca" pod "774786ea-68fe-4aa5-b074-051094b8bff4" (UID: "774786ea-68fe-4aa5-b074-051094b8bff4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:11:01.047972 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.047943    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/774786ea-68fe-4aa5-b074-051094b8bff4-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:01.049714 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.049684    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs" pod "774786ea-68fe-4aa5-b074-051094b8bff4" (UID: "774786ea-68fe-4aa5-b074-051094b8bff4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:11:01.050091 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.050062    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls" pod "774786ea-68fe-4aa5-b074-051094b8bff4" (UID: "774786ea-68fe-4aa5-b074-051094b8bff4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:11:01.050251 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.050114    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44" pod "774786ea-68fe-4aa5-b074-051094b8bff4" (UID: "774786ea-68fe-4aa5-b074-051094b8bff4"). InnerVolumeSpecName "kube-api-access-qwl44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:11:01.149089 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.149057    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:01.149089 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.149086    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwl44\" (UniqueName: \"kubernetes.io/projected/774786ea-68fe-4aa5-b074-051094b8bff4-kube-api-access-qwl44\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:01.149089 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.149096    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774786ea-68fe-4aa5-b074-051094b8bff4-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:01.312735 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.312640    5925 generic.go:356] "Generic (PLEG): container finished" podID="774786ea-68fe-4aa5-b074-051094b8bff4" containerID="92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9" exitCode=0
Oct 31 01:11:01.312735 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.312699    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"
Oct 31 01:11:01.312942 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.312700    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" event={"ID":"774786ea-68fe-4aa5-b074-051094b8bff4","Type":"ContainerDied","Data":"92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9"}
Oct 31 01:11:01.312942 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.312822    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c" event={"ID":"774786ea-68fe-4aa5-b074-051094b8bff4","Type":"ContainerDied","Data":"20c78db7a239c3ee271b9c7c97ae9c58a8e245a72dfd15a46bdf236b9fa28fbe"}
Oct 31 01:11:01.312942 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.312847    5925 scope.go:122] "RemoveContainer" containerID="92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9"
Oct 31 01:11:01.325871 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.325648    5925 scope.go:122] "RemoveContainer" containerID="92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9"
Oct 31 01:11:01.326081 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:11:01.326051    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9\": container with ID starting with 92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9 not found: ID does not exist" containerID="92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9"
Oct 31 01:11:01.326160 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.326091    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9"} err="failed to get container status \"92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9\": rpc error: code = NotFound desc = could not find container \"92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9\": container with ID starting with 92e67db3048c47a0fef65c5d98bfd5b755950f6a93b7ccca84614578120fe3f9 not found: ID does not exist"
Oct 31 01:11:01.469979 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.469941    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"]
Oct 31 01:11:01.518574 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:01.518537    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-863fb0-76d94785dc-zgk8c"]
Oct 31 01:11:02.452225 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:02.452184    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="774786ea-68fe-4aa5-b074-051094b8bff4" path="/var/lib/kubelet/pods/774786ea-68fe-4aa5-b074-051094b8bff4/volumes"
Oct 31 01:11:16.544161 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:11:16.544121    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:11:36.739855 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:36.739819    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"]
Oct 31 01:11:36.740390 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:36.740020    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl" podUID="4b55dc35-f3e5-4905-9c0f-0925f4d63785" containerName="manager" containerID="cri-o://94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357" gracePeriod=10
Oct 31 01:11:37.001087 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.001026    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 01:11:37.124464 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.124396    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume\") pod \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") "
Oct 31 01:11:37.124664 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.124492    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg\" (UniqueName: \"kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg\") pod \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\" (UID: \"4b55dc35-f3e5-4905-9c0f-0925f4d63785\") "
Oct 31 01:11:37.125116 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.125092    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume" pod "4b55dc35-f3e5-4905-9c0f-0925f4d63785" (UID: "4b55dc35-f3e5-4905-9c0f-0925f4d63785"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 01:11:37.127430 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.127378    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg" pod "4b55dc35-f3e5-4905-9c0f-0925f4d63785" (UID: "4b55dc35-f3e5-4905-9c0f-0925f4d63785"). InnerVolumeSpecName "kube-api-access-m7csg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:11:37.226175 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.226134    5925 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b55dc35-f3e5-4905-9c0f-0925f4d63785-extensions-socket-volume\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:37.226175 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.226169    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7csg\" (UniqueName: \"kubernetes.io/projected/4b55dc35-f3e5-4905-9c0f-0925f4d63785-kube-api-access-m7csg\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:11:37.537958 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.537919    5925 generic.go:356] "Generic (PLEG): container finished" podID="4b55dc35-f3e5-4905-9c0f-0925f4d63785" containerID="94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357" exitCode=0
Oct 31 01:11:37.538178 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.537977    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"
Oct 31 01:11:37.538178 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.538013    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl" event={"ID":"4b55dc35-f3e5-4905-9c0f-0925f4d63785","Type":"ContainerDied","Data":"94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357"}
Oct 31 01:11:37.538178 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.538079    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl" event={"ID":"4b55dc35-f3e5-4905-9c0f-0925f4d63785","Type":"ContainerDied","Data":"32fa83576d8e0a36d1308601ee6ddf61f4cb8b51fa83e852ef8cae524d56fa18"}
Oct 31 01:11:37.538178 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.538111    5925 scope.go:122] "RemoveContainer" containerID="94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357"
Oct 31 01:11:37.551266 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.551237    5925 scope.go:122] "RemoveContainer" containerID="94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357"
Oct 31 01:11:37.551588 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:11:37.551567    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357\": container with ID starting with 94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357 not found: ID does not exist" containerID="94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357"
Oct 31 01:11:37.551677 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.551596    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357"} err="failed to get container status \"94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357\": rpc error: code = NotFound desc = could not find container \"94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357\": container with ID starting with 94526e6949f38fc5f89da73c499e51d1edda0c9afccf351526e74d66f4735357 not found: ID does not exist"
Oct 31 01:11:37.698524 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.698493    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"]
Oct 31 01:11:37.702452 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:37.702408    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s46bl"]
Oct 31 01:11:38.451629 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:11:38.451593    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b55dc35-f3e5-4905-9c0f-0925f4d63785" path="/var/lib/kubelet/pods/4b55dc35-f3e5-4905-9c0f-0925f4d63785/volumes"
Oct 31 01:11:46.541253 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:11:46.541216    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:12:16.543069 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:12:16.542988    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:12:40.388782 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.388742    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"]
Oct 31 01:12:40.389282 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.389193    5925 cpu_manager.go:414] "containerMap: removing container" podUID="4b55dc35-f3e5-4905-9c0f-0925f4d63785" containerName="manager"
Oct 31 01:12:40.389282 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.389204    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b55dc35-f3e5-4905-9c0f-0925f4d63785" containerName="manager"
Oct 31 01:12:40.389282 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.389243    5925 cpu_manager.go:414] "containerMap: removing container" podUID="774786ea-68fe-4aa5-b074-051094b8bff4" containerName="maas-api"
Oct 31 01:12:40.389282 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.389249    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="774786ea-68fe-4aa5-b074-051094b8bff4" containerName="maas-api"
Oct 31 01:12:40.389442 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.389315    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b55dc35-f3e5-4905-9c0f-0925f4d63785" containerName="manager"
Oct 31 01:12:40.389442 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.389331    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="774786ea-68fe-4aa5-b074-051094b8bff4" containerName="maas-api"
Oct 31 01:12:40.392746 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.392719    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.455748 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.455719    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-42vz9\""
Oct 31 01:12:40.505863 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.505821    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"]
Oct 31 01:12:40.544512 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.544473    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-ztfpj\" (UID: \"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.544665 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.544586    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47fcj\" (UniqueName: \"kubernetes.io/projected/a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61-kube-api-access-47fcj\") pod \"kuadrant-operator-controller-manager-678d87766f-ztfpj\" (UID: \"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.645723 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.645643    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47fcj\" (UniqueName: \"kubernetes.io/projected/a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61-kube-api-access-47fcj\") pod \"kuadrant-operator-controller-manager-678d87766f-ztfpj\" (UID: \"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.645903 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.645765    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-ztfpj\" (UID: \"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.646144 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.646123    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-ztfpj\" (UID: \"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.704205 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.704179    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47fcj\" (UniqueName: \"kubernetes.io/projected/a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61-kube-api-access-47fcj\") pod \"kuadrant-operator-controller-manager-678d87766f-ztfpj\" (UID: \"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:40.705968 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:40.705951    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:41.188230 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:41.188198    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"]
Oct 31 01:12:41.229907 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:12:41.229878    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c1303c_5f9f_44f3_a65e_4ef3dd2fba61.slice/crio-9bfacfce2c246805d6e40a21d6730ad53ad69911cadf63e687c854bb5675c208 WatchSource:0}: Error finding container 9bfacfce2c246805d6e40a21d6730ad53ad69911cadf63e687c854bb5675c208: Status 404 returned error can't find the container with id 9bfacfce2c246805d6e40a21d6730ad53ad69911cadf63e687c854bb5675c208
Oct 31 01:12:41.914518 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:41.914479    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj" event={"ID":"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61","Type":"ContainerStarted","Data":"40747ea2aabf583bd8ad9e41fac51bf401703e503e225fb331a7e4cf168f3dba"}
Oct 31 01:12:41.915031 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:41.914546    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:12:41.915031 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:41.914570    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj" event={"ID":"a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61","Type":"ContainerStarted","Data":"9bfacfce2c246805d6e40a21d6730ad53ad69911cadf63e687c854bb5675c208"}
Oct 31 01:12:42.137884 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:42.137828    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj" podStartSLOduration=2.137812932 podStartE2EDuration="2.137812932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:12:42.089309845 +0000 UTC m=+3463.778189785" watchObservedRunningTime="2026-10-31 01:12:42.137812932 +0000 UTC m=+3463.826692878"
Oct 31 01:12:46.541332 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:12:46.541290    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:12:52.922483 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:12:52.922454    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-ztfpj"
Oct 31 01:13:16.542134 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:13:16.542096    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:13:46.542976 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:13:46.542936    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:14:01.525170 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.525131    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"]
Oct 31 01:14:01.529258 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.529232    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.562686 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.562652    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.562862 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.562712    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbrt\" (UniqueName: \"kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.562862 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.562736    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.563018 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.562990    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.579465 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.579431    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-abe7bd-serving-cert\""
Oct 31 01:14:01.629300 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.629258    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"]
Oct 31 01:14:01.663721 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.663684    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.663932 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.663733    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbrt\" (UniqueName: \"kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.663932 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.663756    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.663932 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.663873    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.664199 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:14:01.664171    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-serving-cert: secret "maas-api-e2e-worker-single-main-abe7bd-serving-cert" not found
Oct 31 01:14:01.664341 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:14:01.664246    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls podName:5a8c93b7-ff73-468d-9fc4-9d8e62157803 nodeName:}" failed. No retries permitted until 2026-10-31 01:14:02.164228315 +0000 UTC m=+3543.853108243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls") pod "maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" (UID: "5a8c93b7-ff73-468d-9fc4-9d8e62157803") : secret "maas-api-e2e-worker-single-main-abe7bd-serving-cert" not found
Oct 31 01:14:01.664560 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.664535    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.667288 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.667260    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:01.725058 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:01.725027    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbrt\" (UniqueName: \"kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:02.170674 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:02.170632    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:02.173107 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:02.173076    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:02.442916 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:02.442829    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:02.819428 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:02.819326    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"]
Oct 31 01:14:02.825804 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:14:02.825776    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8c93b7_ff73_468d_9fc4_9d8e62157803.slice/crio-f2f934c1e2ddb74d05e1885c79aa30f5f715a0d2e430f813ac6361137b8287de WatchSource:0}: Error finding container f2f934c1e2ddb74d05e1885c79aa30f5f715a0d2e430f813ac6361137b8287de: Status 404 returned error can't find the container with id f2f934c1e2ddb74d05e1885c79aa30f5f715a0d2e430f813ac6361137b8287de
Oct 31 01:14:03.421430 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:03.421388    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" event={"ID":"5a8c93b7-ff73-468d-9fc4-9d8e62157803","Type":"ContainerStarted","Data":"f2f934c1e2ddb74d05e1885c79aa30f5f715a0d2e430f813ac6361137b8287de"}
Oct 31 01:14:04.429127 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:04.429089    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" event={"ID":"5a8c93b7-ff73-468d-9fc4-9d8e62157803","Type":"ContainerStarted","Data":"639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2"}
Oct 31 01:14:04.429571 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:04.429233    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:04.543273 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:04.543218    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" podStartSLOduration=2.639643584 podStartE2EDuration="3.543205121s" totalImagesPullingTime="903.561537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:14:04.541798243 +0000 UTC m=+3546.230678189" watchObservedRunningTime="2026-10-31 01:14:04.543205121 +0000 UTC m=+3546.232085113"
Oct 31 01:14:10.441037 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:10.441002    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:14:16.542200 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:14:16.542163    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:14:46.541693 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:14:46.541655    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:14:59.050297 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:59.050181    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:14:59.066121 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:14:59.066102    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:15:16.545629 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:15:16.545584    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:15:34.144041 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:34.144004    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"]
Oct 31 01:15:34.144619 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:34.144209    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" podUID="5a8c93b7-ff73-468d-9fc4-9d8e62157803" containerName="maas-api" containerID="cri-o://639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2" gracePeriod=30
Oct 31 01:15:35.405282 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.405245    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:15:35.515261 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.515180    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca\") pod \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") "
Oct 31 01:15:35.515261 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.515229    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\") pod \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") "
Oct 31 01:15:35.515261 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.515259    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs\") pod \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") "
Oct 31 01:15:35.515572 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.515323    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt\" (UniqueName: \"kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt\") pod \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\" (UID: \"5a8c93b7-ff73-468d-9fc4-9d8e62157803\") "
Oct 31 01:15:35.515636 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.515610    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca" pod "5a8c93b7-ff73-468d-9fc4-9d8e62157803" (UID: "5a8c93b7-ff73-468d-9fc4-9d8e62157803"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:15:35.515750 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.515729    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8c93b7-ff73-468d-9fc4-9d8e62157803-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:15:35.517753 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.517729    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt" pod "5a8c93b7-ff73-468d-9fc4-9d8e62157803" (UID: "5a8c93b7-ff73-468d-9fc4-9d8e62157803"). InnerVolumeSpecName "kube-api-access-4xbrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:15:35.518196 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.518144    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls" pod "5a8c93b7-ff73-468d-9fc4-9d8e62157803" (UID: "5a8c93b7-ff73-468d-9fc4-9d8e62157803"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:15:35.518196 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.518165    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs" pod "5a8c93b7-ff73-468d-9fc4-9d8e62157803" (UID: "5a8c93b7-ff73-468d-9fc4-9d8e62157803"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:15:35.617121 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.617084    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xbrt\" (UniqueName: \"kubernetes.io/projected/5a8c93b7-ff73-468d-9fc4-9d8e62157803-kube-api-access-4xbrt\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:15:35.617121 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.617116    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:15:35.617319 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.617131    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a8c93b7-ff73-468d-9fc4-9d8e62157803-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:15:35.967321 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.967285    5925 generic.go:356] "Generic (PLEG): container finished" podID="5a8c93b7-ff73-468d-9fc4-9d8e62157803" containerID="639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2" exitCode=0
Oct 31 01:15:35.967537 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.967336    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"
Oct 31 01:15:35.967537 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.967342    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" event={"ID":"5a8c93b7-ff73-468d-9fc4-9d8e62157803","Type":"ContainerDied","Data":"639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2"}
Oct 31 01:15:35.967537 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.967386    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55" event={"ID":"5a8c93b7-ff73-468d-9fc4-9d8e62157803","Type":"ContainerDied","Data":"f2f934c1e2ddb74d05e1885c79aa30f5f715a0d2e430f813ac6361137b8287de"}
Oct 31 01:15:35.967537 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.967407    5925 scope.go:122] "RemoveContainer" containerID="639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2"
Oct 31 01:15:35.977520 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.977499    5925 scope.go:122] "RemoveContainer" containerID="639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2"
Oct 31 01:15:35.977750 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:15:35.977732    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2\": container with ID starting with 639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2 not found: ID does not exist" containerID="639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2"
Oct 31 01:15:35.977815 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:35.977756    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2"} err="failed to get container status \"639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2\": rpc error: code = NotFound desc = could not find container \"639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2\": container with ID starting with 639dc7af668c73f04c5a10ca27ded3b2e4adc193bfa26e314429f6b4079175f2 not found: ID does not exist"
Oct 31 01:15:36.124754 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:36.124725    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"]
Oct 31 01:15:36.130382 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:36.130354    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-abe7bd-5889fc8655-wbf55"]
Oct 31 01:15:36.452037 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:15:36.451998    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a8c93b7-ff73-468d-9fc4-9d8e62157803" path="/var/lib/kubelet/pods/5a8c93b7-ff73-468d-9fc4-9d8e62157803/volumes"
Oct 31 01:15:46.542440 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:15:46.542378    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:16:04.425626 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:16:04.425583    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 01:16:04.426289 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:16:04.425668    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 01:16:16.541933 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:16:16.541884    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:16:46.541999 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:16:46.541959    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:17:16.542203 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:17:16.542161    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:17:28.013438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:17:28.012544    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-qfcgh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.130:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 01:17:28.013438 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:17:28.012616    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-qfcgh" podUID="d1dcda1c-caa1-454f-aed7-aa6f79a0da0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.130:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 01:17:46.542579 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:17:46.542542    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:18:12.547396 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.547318    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"]
Oct 31 01:18:12.547887 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.547871    5925 cpu_manager.go:414] "containerMap: removing container" podUID="5a8c93b7-ff73-468d-9fc4-9d8e62157803" containerName="maas-api"
Oct 31 01:18:12.547951 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.547889    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a8c93b7-ff73-468d-9fc4-9d8e62157803" containerName="maas-api"
Oct 31 01:18:12.548024 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.548010    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a8c93b7-ff73-468d-9fc4-9d8e62157803" containerName="maas-api"
Oct 31 01:18:12.551307 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.551288    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.630565 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.630528    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d57edfb6-a726-41b3-93b4-81cd61552c70-maas-api-tls\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.630757 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.630577    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d57edfb6-a726-41b3-93b4-81cd61552c70-openshift-service-ca\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.630757 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.630682    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d57edfb6-a726-41b3-93b4-81cd61552c70-metrics-certs\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.630856 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.630816    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42mk\" (UniqueName: \"kubernetes.io/projected/d57edfb6-a726-41b3-93b4-81cd61552c70-kube-api-access-d42mk\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.651228 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.651194    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"]
Oct 31 01:18:12.732117 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.732072    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d57edfb6-a726-41b3-93b4-81cd61552c70-openshift-service-ca\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.732305 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.732171    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d57edfb6-a726-41b3-93b4-81cd61552c70-metrics-certs\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.732382 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.732316    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d42mk\" (UniqueName: \"kubernetes.io/projected/d57edfb6-a726-41b3-93b4-81cd61552c70-kube-api-access-d42mk\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.732382 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.732357    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d57edfb6-a726-41b3-93b4-81cd61552c70-maas-api-tls\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.732846 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.732820    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d57edfb6-a726-41b3-93b4-81cd61552c70-openshift-service-ca\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.734830 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.734806    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d57edfb6-a726-41b3-93b4-81cd61552c70-metrics-certs\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.734919 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.734873    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d57edfb6-a726-41b3-93b4-81cd61552c70-maas-api-tls\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.790615 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.790586    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42mk\" (UniqueName: \"kubernetes.io/projected/d57edfb6-a726-41b3-93b4-81cd61552c70-kube-api-access-d42mk\") pod \"maas-api-5cbd79cdff-b2mzc\" (UID: \"d57edfb6-a726-41b3-93b4-81cd61552c70\") " pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:12.864530 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:12.864500    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:13.247405 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:13.247321    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"]
Oct 31 01:18:13.253559 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:18:13.253532    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57edfb6_a726_41b3_93b4_81cd61552c70.slice/crio-8e33d11d3bd18e83906af69746440e7a759a9280b56c29bdc7ea812d3375b32d WatchSource:0}: Error finding container 8e33d11d3bd18e83906af69746440e7a759a9280b56c29bdc7ea812d3375b32d: Status 404 returned error can't find the container with id 8e33d11d3bd18e83906af69746440e7a759a9280b56c29bdc7ea812d3375b32d
Oct 31 01:18:13.255386 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:13.255367    5925 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 01:18:14.046168 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:14.046130    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc" event={"ID":"d57edfb6-a726-41b3-93b4-81cd61552c70","Type":"ContainerStarted","Data":"8e33d11d3bd18e83906af69746440e7a759a9280b56c29bdc7ea812d3375b32d"}
Oct 31 01:18:15.054289 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:15.054250    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc" event={"ID":"d57edfb6-a726-41b3-93b4-81cd61552c70","Type":"ContainerStarted","Data":"89d1bfab10df8f2437b9b41cc628a2d76da750f370211f95f069a494761be507"}
Oct 31 01:18:15.054890 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:15.054381    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:15.169338 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:15.169285    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc" podStartSLOduration=2.291837034 podStartE2EDuration="3.169271485s" totalImagesPullingTime="877.434451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:18:15.166890594 +0000 UTC m=+3796.855770541" watchObservedRunningTime="2026-10-31 01:18:15.169271485 +0000 UTC m=+3796.858151432"
Oct 31 01:18:16.545302 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:18:16.545257    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:18:21.066486 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:21.066458    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5cbd79cdff-b2mzc"
Oct 31 01:18:21.229536 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:21.229488    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"]
Oct 31 01:18:21.229751 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:21.229712    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5" podUID="f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" containerName="maas-api" containerID="cri-o://1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5" gracePeriod=30
Oct 31 01:18:22.508510 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.508485    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 01:18:22.632479 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.632444    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt\" (UniqueName: \"kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt\") pod \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") "
Oct 31 01:18:22.632678 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.632533    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs\") pod \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") "
Oct 31 01:18:22.632678 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.632611    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca\") pod \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") "
Oct 31 01:18:22.632770 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.632753    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls\") pod \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\" (UID: \"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca\") "
Oct 31 01:18:22.633009 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.632980    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca" pod "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" (UID: "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:18:22.633144 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.633127    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:18:22.634722 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.634694    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls" pod "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" (UID: "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:18:22.634856 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.634766    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt" pod "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" (UID: "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca"). InnerVolumeSpecName "kube-api-access-9srlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:18:22.634856 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.634798    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs" pod "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" (UID: "f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:18:22.734126 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.734088    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:18:22.734126 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.734118    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9srlt\" (UniqueName: \"kubernetes.io/projected/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-kube-api-access-9srlt\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:18:22.734126 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:22.734133    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:18:23.100597 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.100559    5925 generic.go:356] "Generic (PLEG): container finished" podID="f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" containerID="1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5" exitCode=0
Oct 31 01:18:23.100778 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.100612    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"
Oct 31 01:18:23.100778 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.100649    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5" event={"ID":"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca","Type":"ContainerDied","Data":"1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5"}
Oct 31 01:18:23.100778 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.100703    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-799fd7675f-82tq5" event={"ID":"f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca","Type":"ContainerDied","Data":"8b459577ab2c7a240c8cbc5661511c7511ed81b9a70781b8f1e2a67c6d691a5a"}
Oct 31 01:18:23.100778 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.100727    5925 scope.go:122] "RemoveContainer" containerID="1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5"
Oct 31 01:18:23.111770 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.111751    5925 scope.go:122] "RemoveContainer" containerID="1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5"
Oct 31 01:18:23.112029 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:18:23.112011    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5\": container with ID starting with 1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5 not found: ID does not exist" containerID="1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5"
Oct 31 01:18:23.112080 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.112037    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5"} err="failed to get container status \"1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5\": rpc error: code = NotFound desc = could not find container \"1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5\": container with ID starting with 1e397c2167495a1d31ce889d226ed749754471e61b071365fb56167adca5c5d5 not found: ID does not exist"
Oct 31 01:18:23.259349 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.259308    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"]
Oct 31 01:18:23.306895 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:23.306862    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-799fd7675f-82tq5"]
Oct 31 01:18:24.452176 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:24.452142    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" path="/var/lib/kubelet/pods/f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca/volumes"
Oct 31 01:18:28.671475 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.671435    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"]
Oct 31 01:18:28.672239 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.672217    5925 cpu_manager.go:414] "containerMap: removing container" podUID="f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" containerName="maas-api"
Oct 31 01:18:28.672239 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.672237    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" containerName="maas-api"
Oct 31 01:18:28.672399 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.672365    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="f0e1e827-0c14-45d5-b6f0-ae6403a4c8ca" containerName="maas-api"
Oct 31 01:18:28.677522 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.677497    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.727465 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.727408    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-576e86c8-serving-cert\""
Oct 31 01:18:28.777492 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.777454    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"]
Oct 31 01:18:28.793390 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.793356    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.793556 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.793436    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xj5d\" (UniqueName: \"kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.793608 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.793574    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.793656 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.793613    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.894598 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.894558    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.894792 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.894609    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.894792 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.894662    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.894792 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.894700    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xj5d\" (UniqueName: \"kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.894792 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:18:28.894710    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-serving-cert: secret "maas-api-e2e-ait-576e86c8-serving-cert" not found
Oct 31 01:18:28.894792 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:18:28.894786    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls podName:48a7ab40-fd31-43e0-9abb-096f1e265b1d nodeName:}" failed. No retries permitted until 2026-10-31 01:18:29.394768305 +0000 UTC m=+3811.083648229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls") pod "maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" (UID: "48a7ab40-fd31-43e0-9abb-096f1e265b1d") : secret "maas-api-e2e-ait-576e86c8-serving-cert" not found
Oct 31 01:18:28.895298 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.895278    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.897181 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.897163    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:28.955797 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:28.955724    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xj5d\" (UniqueName: \"kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:29.399614 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:29.399573    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:29.402191 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:29.402165    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\") pod \"maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:29.592729 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:29.592692    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:29.975812 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:29.975547    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"]
Oct 31 01:18:29.986735 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:18:29.986705    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a7ab40_fd31_43e0_9abb_096f1e265b1d.slice/crio-c0d217eed83f12961fdfc5135eadb034aa15ea84d473dfabbbece2222efc9849 WatchSource:0}: Error finding container c0d217eed83f12961fdfc5135eadb034aa15ea84d473dfabbbece2222efc9849: Status 404 returned error can't find the container with id c0d217eed83f12961fdfc5135eadb034aa15ea84d473dfabbbece2222efc9849
Oct 31 01:18:30.142198 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:30.142162    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" event={"ID":"48a7ab40-fd31-43e0-9abb-096f1e265b1d","Type":"ContainerStarted","Data":"c0d217eed83f12961fdfc5135eadb034aa15ea84d473dfabbbece2222efc9849"}
Oct 31 01:18:31.149556 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:31.149519    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" event={"ID":"48a7ab40-fd31-43e0-9abb-096f1e265b1d","Type":"ContainerStarted","Data":"b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3"}
Oct 31 01:18:31.149995 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:31.149711    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:31.263273 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:31.263170    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" podStartSLOduration=2.316777717 podStartE2EDuration="3.263156358s" totalImagesPullingTime="946.378641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:18:31.261943019 +0000 UTC m=+3812.950822965" watchObservedRunningTime="2026-10-31 01:18:31.263156358 +0000 UTC m=+3812.952036321"
Oct 31 01:18:37.162925 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:18:37.162890    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:18:46.542963 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:18:46.542925    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:19:16.542092 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:19:16.542053    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:19:20.342360 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.342323    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"]
Oct 31 01:19:20.342886 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.342566    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" podUID="48a7ab40-fd31-43e0-9abb-096f1e265b1d" containerName="maas-api" containerID="cri-o://b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3" gracePeriod=30
Oct 31 01:19:20.599060 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.599001    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:19:20.716546 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.716517    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d\" (UniqueName: \"kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d\") pod \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") "
Oct 31 01:19:20.716793 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.716590    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\") pod \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") "
Oct 31 01:19:20.716793 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.716647    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca\") pod \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") "
Oct 31 01:19:20.716793 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.716688    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs\") pod \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\" (UID: \"48a7ab40-fd31-43e0-9abb-096f1e265b1d\") "
Oct 31 01:19:20.718124 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.718096    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca" pod "48a7ab40-fd31-43e0-9abb-096f1e265b1d" (UID: "48a7ab40-fd31-43e0-9abb-096f1e265b1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:19:20.719804 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.719775    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs" pod "48a7ab40-fd31-43e0-9abb-096f1e265b1d" (UID: "48a7ab40-fd31-43e0-9abb-096f1e265b1d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:19:20.719909 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.719881    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d" pod "48a7ab40-fd31-43e0-9abb-096f1e265b1d" (UID: "48a7ab40-fd31-43e0-9abb-096f1e265b1d"). InnerVolumeSpecName "kube-api-access-4xj5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:19:20.720527 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.720504    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls" pod "48a7ab40-fd31-43e0-9abb-096f1e265b1d" (UID: "48a7ab40-fd31-43e0-9abb-096f1e265b1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:19:20.818192 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.818157    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xj5d\" (UniqueName: \"kubernetes.io/projected/48a7ab40-fd31-43e0-9abb-096f1e265b1d-kube-api-access-4xj5d\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:19:20.818192 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.818187    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:19:20.818386 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.818211    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48a7ab40-fd31-43e0-9abb-096f1e265b1d-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:19:20.818386 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:20.818220    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/48a7ab40-fd31-43e0-9abb-096f1e265b1d-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:19:21.448317 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.448278    5925 generic.go:356] "Generic (PLEG): container finished" podID="48a7ab40-fd31-43e0-9abb-096f1e265b1d" containerID="b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3" exitCode=0
Oct 31 01:19:21.448762 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.448331    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"
Oct 31 01:19:21.448762 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.448354    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" event={"ID":"48a7ab40-fd31-43e0-9abb-096f1e265b1d","Type":"ContainerDied","Data":"b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3"}
Oct 31 01:19:21.448762 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.448404    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94" event={"ID":"48a7ab40-fd31-43e0-9abb-096f1e265b1d","Type":"ContainerDied","Data":"c0d217eed83f12961fdfc5135eadb034aa15ea84d473dfabbbece2222efc9849"}
Oct 31 01:19:21.448762 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.448440    5925 scope.go:122] "RemoveContainer" containerID="b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3"
Oct 31 01:19:21.458904 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.458882    5925 scope.go:122] "RemoveContainer" containerID="b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3"
Oct 31 01:19:21.459145 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:19:21.459123    5925 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3\": container with ID starting with b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3 not found: ID does not exist" containerID="b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3"
Oct 31 01:19:21.459197 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.459151    5925 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3"} err="failed to get container status \"b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3\": rpc error: code = NotFound desc = could not find container \"b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3\": container with ID starting with b09d471f5fc58416cde34850a6b830263123352f220b19a4eb0839a0b39d07f3 not found: ID does not exist"
Oct 31 01:19:21.606779 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.606746    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"]
Oct 31 01:19:21.610841 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:21.610812    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-576e86c8-df5bbcf57-xnp94"]
Oct 31 01:19:22.452320 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:22.452286    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48a7ab40-fd31-43e0-9abb-096f1e265b1d" path="/var/lib/kubelet/pods/48a7ab40-fd31-43e0-9abb-096f1e265b1d/volumes"
Oct 31 01:19:39.112283 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.112192    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"]
Oct 31 01:19:39.113065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.113036    5925 cpu_manager.go:414] "containerMap: removing container" podUID="48a7ab40-fd31-43e0-9abb-096f1e265b1d" containerName="maas-api"
Oct 31 01:19:39.113065 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.113060    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48a7ab40-fd31-43e0-9abb-096f1e265b1d" containerName="maas-api"
Oct 31 01:19:39.113224 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.113179    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="48a7ab40-fd31-43e0-9abb-096f1e265b1d" containerName="maas-api"
Oct 31 01:19:39.116891 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.116871    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.166930 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.166896    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-44d22c-serving-cert\""
Oct 31 01:19:39.207339 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.207300    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.207551 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.207350    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.207551 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.207459    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.207657 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.207545    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9cwv\" (UniqueName: \"kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.217168 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.217136    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"]
Oct 31 01:19:39.309076 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.309041    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.309303 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.309095    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.309303 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.309209    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.309303 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:19:39.309253    5925 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-serving-cert: secret "maas-api-e2e-authcfg-http-44d22c-serving-cert" not found
Oct 31 01:19:39.309506 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:19:39.309331    5925 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls podName:18703e8b-028c-4087-b536-2cf988dce1ce nodeName:}" failed. No retries permitted until 2026-10-31 01:19:39.80930568 +0000 UTC m=+3881.498185629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls") pod "maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" (UID: "18703e8b-028c-4087-b536-2cf988dce1ce") : secret "maas-api-e2e-authcfg-http-44d22c-serving-cert" not found
Oct 31 01:19:39.309506 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.309260    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9cwv\" (UniqueName: \"kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.310032 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.310008    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.311761 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.311738    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.368528 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.368450    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9cwv\" (UniqueName: \"kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.814511 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.814377    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:39.816940 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:39.816900    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:40.030539 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:40.030500    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:40.405884 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:40.405852    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"]
Oct 31 01:19:40.412005 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:19:40.411971    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18703e8b_028c_4087_b536_2cf988dce1ce.slice/crio-085b6b90164f6a8367200d4a7f1a16421459068072afd5c90d8377b19f17ca50 WatchSource:0}: Error finding container 085b6b90164f6a8367200d4a7f1a16421459068072afd5c90d8377b19f17ca50: Status 404 returned error can't find the container with id 085b6b90164f6a8367200d4a7f1a16421459068072afd5c90d8377b19f17ca50
Oct 31 01:19:40.563241 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:40.563200    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" event={"ID":"18703e8b-028c-4087-b536-2cf988dce1ce","Type":"ContainerStarted","Data":"085b6b90164f6a8367200d4a7f1a16421459068072afd5c90d8377b19f17ca50"}
Oct 31 01:19:41.570525 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:41.570487    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" event={"ID":"18703e8b-028c-4087-b536-2cf988dce1ce","Type":"ContainerStarted","Data":"7edb1c915d2bcd88add00c26275e4772216942c91061be07430d33252657772a"}
Oct 31 01:19:41.570927 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:41.570561    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:41.684019 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:41.683904    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" podStartSLOduration=1.734301241 podStartE2EDuration="2.683890859s" totalImagesPullingTime="949.589618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:19:41.68268514 +0000 UTC m=+3883.371565087" watchObservedRunningTime="2026-10-31 01:19:41.683890859 +0000 UTC m=+3883.372770806"
Oct 31 01:19:46.543231 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:19:46.543193    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:19:47.582134 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:47.582105    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:19:59.091864 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:59.091836    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:19:59.109529 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:19:59.109508    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:20:16.543098 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:20:16.543049    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:20:46.543399 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:20:46.543360    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:21:16.543137 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:21:16.543051    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:21:37.041971 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.041937    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"]
Oct 31 01:21:37.042510 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.042166    5925 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" podUID="18703e8b-028c-4087-b536-2cf988dce1ce" containerName="maas-api" containerID="cri-o://7edb1c915d2bcd88add00c26275e4772216942c91061be07430d33252657772a" gracePeriod=30
Oct 31 01:21:37.254538 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.254504    5925 generic.go:356] "Generic (PLEG): container finished" podID="18703e8b-028c-4087-b536-2cf988dce1ce" containerID="7edb1c915d2bcd88add00c26275e4772216942c91061be07430d33252657772a" exitCode=0
Oct 31 01:21:37.254731 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.254575    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" event={"ID":"18703e8b-028c-4087-b536-2cf988dce1ce","Type":"ContainerDied","Data":"7edb1c915d2bcd88add00c26275e4772216942c91061be07430d33252657772a"}
Oct 31 01:21:37.307166 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.307092    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:21:37.378695 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.378664    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv\" (UniqueName: \"kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv\") pod \"18703e8b-028c-4087-b536-2cf988dce1ce\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") "
Oct 31 01:21:37.378855 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.378710    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs\") pod \"18703e8b-028c-4087-b536-2cf988dce1ce\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") "
Oct 31 01:21:37.378855 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.378786    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca\") pod \"18703e8b-028c-4087-b536-2cf988dce1ce\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") "
Oct 31 01:21:37.378855 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.378834    5925 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\") pod \"18703e8b-028c-4087-b536-2cf988dce1ce\" (UID: \"18703e8b-028c-4087-b536-2cf988dce1ce\") "
Oct 31 01:21:37.379204 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.379182    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca" pod "18703e8b-028c-4087-b536-2cf988dce1ce" (UID: "18703e8b-028c-4087-b536-2cf988dce1ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:21:37.380909 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.380877    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls" pod "18703e8b-028c-4087-b536-2cf988dce1ce" (UID: "18703e8b-028c-4087-b536-2cf988dce1ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:21:37.381048 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.380928    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv" pod "18703e8b-028c-4087-b536-2cf988dce1ce" (UID: "18703e8b-028c-4087-b536-2cf988dce1ce"). InnerVolumeSpecName "kube-api-access-v9cwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:21:37.381048 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.380951    5925 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs" pod "18703e8b-028c-4087-b536-2cf988dce1ce" (UID: "18703e8b-028c-4087-b536-2cf988dce1ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:21:37.480682 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.480645    5925 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18703e8b-028c-4087-b536-2cf988dce1ce-openshift-service-ca\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:37.480682 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.480679    5925 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-maas-api-tls\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:37.480866 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.480689    5925 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9cwv\" (UniqueName: \"kubernetes.io/projected/18703e8b-028c-4087-b536-2cf988dce1ce-kube-api-access-v9cwv\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:37.480866 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:37.480700    5925 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18703e8b-028c-4087-b536-2cf988dce1ce-metrics-certs\") on node \"ip-10-0-140-47.us-west-2.compute.internal\" DevicePath \"\""
Oct 31 01:21:38.262741 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:38.262705    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr" event={"ID":"18703e8b-028c-4087-b536-2cf988dce1ce","Type":"ContainerDied","Data":"085b6b90164f6a8367200d4a7f1a16421459068072afd5c90d8377b19f17ca50"}
Oct 31 01:21:38.263265 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:38.262765    5925 scope.go:122] "RemoveContainer" containerID="7edb1c915d2bcd88add00c26275e4772216942c91061be07430d33252657772a"
Oct 31 01:21:38.263265 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:38.262767    5925 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"
Oct 31 01:21:38.422092 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:38.422054    5925 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"]
Oct 31 01:21:38.469643 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:38.469611    5925 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-44d22c-d47c7fc65-gnbqr"]
Oct 31 01:21:40.452050 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:21:40.452019    5925 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18703e8b-028c-4087-b536-2cf988dce1ce" path="/var/lib/kubelet/pods/18703e8b-028c-4087-b536-2cf988dce1ce/volumes"
Oct 31 01:21:46.543455 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:21:46.543399    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:22:16.543208 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:22:16.543172    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:22:34.427632 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:22:34.427578    5925 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-cnm9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 01:22:34.428133 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:22:34.427660    5925 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-cnm9b" podUID="f37e7568-ca40-42a9-aadc-bdb63bac1c52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 01:22:46.543992 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:22:46.543953    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:22:59.431895 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:22:59.431856    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c46f9484-lpckr_1e3a1ea8-355d-4fe3-a7d9-388e908b80a4/authorino/0.log"
Oct 31 01:23:10.610321 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:10.610286    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-798c598657-7v952_fccaa72d-1270-45cf-a711-c97b7c58eb91/manager/0.log"
Oct 31 01:23:10.968574 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:10.968485    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-6hlp9_753258f7-44db-4369-9adf-62a1fc9af8f3/manager/0.log"
Oct 31 01:23:11.973982 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:11.973952    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d56c449c7-vhgvt_b2ee7ba7-d231-4ac9-874d-6be9149040f0/manager/0.log"
Oct 31 01:23:12.456495 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:12.456468    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-m6h68_3283f856-53a9-4f18-a725-4d6a017f1e85/server/0.log"
Oct 31 01:23:13.138205 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:13.138171    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-n99lx_8d52ab28-2c13-4f05-8a30-610e75869c18/proxy/0.log"
Oct 31 01:23:13.936122 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:13.936083    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5cbd79cdff-b2mzc_d57edfb6-a726-41b3-93b4-81cd61552c70/maas-api/0.log"
Oct 31 01:23:16.543146 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:23:16.543106    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:23:16.726611 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:16.726576    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c46f9484-lpckr_1e3a1ea8-355d-4fe3-a7d9-388e908b80a4/authorino/0.log"
Oct 31 01:23:17.180350 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:17.180316    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-c6s66_a1dae338-b202-45cc-9d47-e1d5df260ec2/manager/0.log"
Oct 31 01:23:17.427571 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:17.427540    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-g767d_c5441a7e-9026-4b36-9919-f3237533a88d/manager/0.log"
Oct 31 01:23:17.936183 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:17.936146    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-ztfpj_a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61/manager/0.log"
Oct 31 01:23:18.495009 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:18.494979    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n5zkn_64678e6d-a55f-462b-a711-b0cd37bde52f/manager/0.log"
Oct 31 01:23:19.335507 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:19.335474    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6_0a24fae2-5878-4ea9-8a51-1ecb6685fd76/istio-proxy/0.log"
Oct 31 01:23:20.836613 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:20.836584    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-cnm9b_f37e7568-ca40-42a9-aadc-bdb63bac1c52/istio-proxy/1.log"
Oct 31 01:23:22.182901 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:22.182867    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-qfcgh_d1dcda1c-caa1-454f-aed7-aa6f79a0da0e/istio-proxy/0.log"
Oct 31 01:23:22.456835 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:22.456750    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-vxqbg_c7823783-3b3c-425f-bbf2-662f16cb2a91/istio-proxy/0.log"
Oct 31 01:23:23.207595 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:23.207564    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-xhpxl_96f3edec-f3b1-40e3-bc4c-3d15961274c8/payload-pre-processing/0.log"
Oct 31 01:23:23.428496 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:23.428469    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-48lzq_2b16239d-fee3-4921-b7f3-42b62acceefb/payload-processing/0.log"
Oct 31 01:23:23.654229 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:23.654198    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c7d9879df-g4m8t_b899807e-b82b-4d93-b1b7-ce371ff91281/router/0.log"
Oct 31 01:23:24.165912 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:24.165874    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-cnm9b_f37e7568-ca40-42a9-aadc-bdb63bac1c52/istio-proxy/0.log"
Oct 31 01:23:24.774940 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:24.774903    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9_85f0e456-4f56-4a9e-810c-6e9c63c7ead4/main/0.log"
Oct 31 01:23:25.050006 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:25.049937    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-qtlrw_29677d27-bc2f-4905-966f-2fad1ee2b299/main/0.log"
Oct 31 01:23:25.278645 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:25.278618    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-2vslx_58c6dc90-68f5-4c2e-9342-338eba848e8f/main/0.log"
Oct 31 01:23:25.506728 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:25.506693    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-2qt9q_24e4c0b0-dea7-4a57-97b5-c285d31ab68d/main/0.log"
Oct 31 01:23:25.738599 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:25.738565    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf_5ebcd7ad-6829-4857-a4d7-b76b548e62ab/main/0.log"
Oct 31 01:23:25.968960 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:25.968930    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-wskrh_35f1d210-0daa-47b6-8116-788c6839d95e/main/0.log"
Oct 31 01:23:27.387084 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:27.387049    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c46f9484-lpckr_1e3a1ea8-355d-4fe3-a7d9-388e908b80a4/authorino/0.log"
Oct 31 01:23:37.170878 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:37.170843    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-798c598657-7v952_fccaa72d-1270-45cf-a711-c97b7c58eb91/manager/0.log"
Oct 31 01:23:37.538274 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:37.538189    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-6hlp9_753258f7-44db-4369-9adf-62a1fc9af8f3/manager/0.log"
Oct 31 01:23:38.453837 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:38.453806    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d56c449c7-vhgvt_b2ee7ba7-d231-4ac9-874d-6be9149040f0/manager/0.log"
Oct 31 01:23:38.843996 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:38.843970    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-m6h68_3283f856-53a9-4f18-a725-4d6a017f1e85/server/0.log"
Oct 31 01:23:39.362180 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:39.362151    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-n99lx_8d52ab28-2c13-4f05-8a30-610e75869c18/proxy/0.log"
Oct 31 01:23:39.946792 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:39.946762    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5cbd79cdff-b2mzc_d57edfb6-a726-41b3-93b4-81cd61552c70/maas-api/0.log"
Oct 31 01:23:42.492142 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:42.492101    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c46f9484-lpckr_1e3a1ea8-355d-4fe3-a7d9-388e908b80a4/authorino/0.log"
Oct 31 01:23:42.955528 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:42.955494    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-c6s66_a1dae338-b202-45cc-9d47-e1d5df260ec2/manager/0.log"
Oct 31 01:23:43.195268 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:43.195230    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-g767d_c5441a7e-9026-4b36-9919-f3237533a88d/manager/0.log"
Oct 31 01:23:43.668730 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:43.668693    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-ztfpj_a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61/manager/0.log"
Oct 31 01:23:44.171738 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:44.171704    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n5zkn_64678e6d-a55f-462b-a711-b0cd37bde52f/manager/0.log"
Oct 31 01:23:44.778944 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:44.778911    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5s8cl6_0a24fae2-5878-4ea9-8a51-1ecb6685fd76/istio-proxy/0.log"
Oct 31 01:23:46.232788 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:46.232753    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-cnm9b_f37e7568-ca40-42a9-aadc-bdb63bac1c52/istio-proxy/1.log"
Oct 31 01:23:46.542846 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:23:46.542756    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:23:47.554692 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:47.554658    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-qfcgh_d1dcda1c-caa1-454f-aed7-aa6f79a0da0e/istio-proxy/0.log"
Oct 31 01:23:47.785076 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:47.785045    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-vxqbg_c7823783-3b3c-425f-bbf2-662f16cb2a91/istio-proxy/0.log"
Oct 31 01:23:48.513224 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:48.513197    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-xhpxl_96f3edec-f3b1-40e3-bc4c-3d15961274c8/payload-pre-processing/0.log"
Oct 31 01:23:48.741684 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:48.741645    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-48lzq_2b16239d-fee3-4921-b7f3-42b62acceefb/payload-processing/0.log"
Oct 31 01:23:48.954318 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:48.954288    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c7d9879df-g4m8t_b899807e-b82b-4d93-b1b7-ce371ff91281/router/0.log"
Oct 31 01:23:49.616259 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:49.616219    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-crcj9_85f0e456-4f56-4a9e-810c-6e9c63c7ead4/main/0.log"
Oct 31 01:23:49.890678 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:49.890598    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-qtlrw_29677d27-bc2f-4905-966f-2fad1ee2b299/main/0.log"
Oct 31 01:23:50.123799 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:50.123759    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-2vslx_58c6dc90-68f5-4c2e-9342-338eba848e8f/main/0.log"
Oct 31 01:23:50.356306 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:50.356273    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-2qt9q_24e4c0b0-dea7-4a57-97b5-c285d31ab68d/main/0.log"
Oct 31 01:23:50.582456 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:50.582403    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8qrhmf_5ebcd7ad-6829-4857-a4d7-b76b548e62ab/main/0.log"
Oct 31 01:23:50.810017 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:23:50.809924    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-wskrh_35f1d210-0daa-47b6-8116-788c6839d95e/main/0.log"
Oct 31 01:24:16.542521 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:24:16.542440    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:24:21.395018 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:24:21.394986    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d56c449c7-vhgvt_b2ee7ba7-d231-4ac9-874d-6be9149040f0/manager/0.log"
Oct 31 01:24:21.933076 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:24:21.933044    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d56c449c7-vhgvt_b2ee7ba7-d231-4ac9-874d-6be9149040f0/manager/0.log"
Oct 31 01:24:22.681120 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:24:22.681092    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-48lzq_2b16239d-fee3-4921-b7f3-42b62acceefb/payload-processing/0.log"
Oct 31 01:24:22.908641 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:24:22.908615    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-48lzq_2b16239d-fee3-4921-b7f3-42b62acceefb/payload-processing/0.log"
Oct 31 01:24:46.542314 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:24:46.542263    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:24:59.131159 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:24:59.131046    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:24:59.150651 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:24:59.150627    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-crbc6_3734cc90-7907-4498-9a6b-7bae4757ff0b/console-operator/2.log"
Oct 31 01:25:02.291845 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:02.291813    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d56c449c7-vhgvt_b2ee7ba7-d231-4ac9-874d-6be9149040f0/manager/0.log"
Oct 31 01:25:02.872819 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:02.872764    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d56c449c7-vhgvt_b2ee7ba7-d231-4ac9-874d-6be9149040f0/manager/0.log"
Oct 31 01:25:03.627719 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:03.627691    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-48lzq_2b16239d-fee3-4921-b7f3-42b62acceefb/payload-processing/0.log"
Oct 31 01:25:03.952970 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:03.952894    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-55fbbbf9dc-48lzq_2b16239d-fee3-4921-b7f3-42b62acceefb/payload-processing/0.log"
Oct 31 01:25:14.292553 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:14.292522    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-65fz2_6362fc09-4b02-49dd-8e75-db40d935cc71/global-pull-secret-syncer/0.log"
Oct 31 01:25:16.118634 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:16.118608    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-7j8dt_e0762913-8550-41b9-a1a8-d2df14f88004/connection-checker/0.log"
Oct 31 01:25:16.541253 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:25:16.541161    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"
Oct 31 01:25:16.547938 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:16.547917    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-k6mcf_9cd937ab-d46d-4bff-8049-485b18bfdb6c/connection-checker/0.log"
Oct 31 01:25:16.970570 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:16.970542    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-sxf6j_6bbd3db6-4290-4d6c-9735-519c8585376b/connection-checker/0.log"
Oct 31 01:25:18.463031 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:18.462999    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-slhsd_6011a7bf-b396-4ff3-90b5-05f7e8aadeb5/konnectivity-agent/0.log"
Oct 31 01:25:19.703236 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:19.703187    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-47.us-west-2.compute.internal_fd984434bab802ab7f7b4fe5c1c36bf9/haproxy/0.log"
Oct 31 01:25:23.615325 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:23.615282    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68c46f9484-lpckr_1e3a1ea8-355d-4fe3-a7d9-388e908b80a4/authorino/0.log"
Oct 31 01:25:23.938112 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:23.938035    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-c6s66_a1dae338-b202-45cc-9d47-e1d5df260ec2/manager/0.log"
Oct 31 01:25:24.108527 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.108490    5925 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"]
Oct 31 01:25:24.108992 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.108978    5925 cpu_manager.go:414] "containerMap: removing container" podUID="18703e8b-028c-4087-b536-2cf988dce1ce" containerName="maas-api"
Oct 31 01:25:24.109049 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.108993    5925 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18703e8b-028c-4087-b536-2cf988dce1ce" containerName="maas-api"
Oct 31 01:25:24.109103 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.109094    5925 memory_manager.go:365] "RemoveStaleState removing state" podUID="18703e8b-028c-4087-b536-2cf988dce1ce" containerName="maas-api"
Oct 31 01:25:24.112109 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.112093    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.164021 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.163994    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bw6xw\"/\"kube-root-ca.crt\""
Oct 31 01:25:24.166540 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.166518    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"]
Oct 31 01:25:24.177938 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.177915    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-podres\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.178049 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.177953    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-lib-modules\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.178107 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.178082    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7rk7\" (UniqueName: \"kubernetes.io/projected/9c8c11cc-9879-4a36-849e-32d14632345d-kube-api-access-b7rk7\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.178186 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.178173    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-sys\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.178222 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.178207    5925 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-proc\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.211255 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.211192    5925 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bw6xw\"/\"openshift-service-ca.crt\""
Oct 31 01:25:24.248272 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.248248    5925 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bw6xw\"/\"default-dockercfg-vkhnz\""
Oct 31 01:25:24.278729 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278698    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7rk7\" (UniqueName: \"kubernetes.io/projected/9c8c11cc-9879-4a36-849e-32d14632345d-kube-api-access-b7rk7\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.278869 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278753    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-sys\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.278869 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278782    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-proc\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.278869 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278828    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-podres\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.278869 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278853    5925 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-lib-modules\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.279042 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278904    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-sys\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.279042 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278922    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-podres\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.279042 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278908    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-proc\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.279042 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.278952    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c8c11cc-9879-4a36-849e-32d14632345d-lib-modules\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.337838 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.337806    5925 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7rk7\" (UniqueName: \"kubernetes.io/projected/9c8c11cc-9879-4a36-849e-32d14632345d-kube-api-access-b7rk7\") pod \"perf-node-gather-daemonset-mg6jm\" (UID: \"9c8c11cc-9879-4a36-849e-32d14632345d\") " pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.360053 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.360032    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-g767d_c5441a7e-9026-4b36-9919-f3237533a88d/manager/0.log"
Oct 31 01:25:24.423467 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.423435    5925 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:24.791744 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:24.791723    5925 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"]
Oct 31 01:25:24.793664 ip-10-0-140-47 kubenswrapper[5925]: W1031 01:25:24.793636    5925 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9c8c11cc_9879_4a36_849e_32d14632345d.slice/crio-06e091700cfedaa597866c98d20b5baab615d810faad8ad9c085962f8b5c5a93 WatchSource:0}: Error finding container 06e091700cfedaa597866c98d20b5baab615d810faad8ad9c085962f8b5c5a93: Status 404 returned error can't find the container with id 06e091700cfedaa597866c98d20b5baab615d810faad8ad9c085962f8b5c5a93
Oct 31 01:25:25.246377 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:25.246348    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-ztfpj_a1c1303c-5f9f-44f3-a65e-4ef3dd2fba61/manager/0.log"
Oct 31 01:25:25.728076 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:25.728042    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm" event={"ID":"9c8c11cc-9879-4a36-849e-32d14632345d","Type":"ContainerStarted","Data":"9dc26ccf27e1704112f22c112c8d9ff7da21621748ecfd9602647aed9a9b7e50"}
Oct 31 01:25:25.728308 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:25.728101    5925 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm" event={"ID":"9c8c11cc-9879-4a36-849e-32d14632345d","Type":"ContainerStarted","Data":"06e091700cfedaa597866c98d20b5baab615d810faad8ad9c085962f8b5c5a93"}
Oct 31 01:25:25.728308 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:25.728272    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:25.839455 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:25.839387    5925 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm" podStartSLOduration=1.839370437 podStartE2EDuration="1.839370437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 01:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:25:25.838437079 +0000 UTC m=+4227.527317023" watchObservedRunningTime="2026-10-31 01:25:25.839370437 +0000 UTC m=+4227.528250381"
Oct 31 01:25:26.124430 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:26.124389    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-n5zkn_64678e6d-a55f-462b-a711-b0cd37bde52f/manager/0.log"
Oct 31 01:25:31.692202 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:31.692169    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-tlc2z_aebe9cd7-a93e-4707-b53c-fdaeddc05258/cluster-monitoring-operator/0.log"
Oct 31 01:25:31.745633 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:31.745603    5925 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bw6xw/perf-node-gather-daemonset-mg6jm"
Oct 31 01:25:36.757656 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:36.757576    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krdbx_d6f57022-10e3-4925-a7f4-06f81c377d46/node-exporter/0.log"
Oct 31 01:25:37.176188 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:37.176161    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krdbx_d6f57022-10e3-4925-a7f4-06f81c377d46/kube-rbac-proxy/0.log"
Oct 31 01:25:37.608619 ip-10-0-140-47 kubenswrapper[5925]: I1031 01:25:37.608594    5925 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krdbx_d6f57022-10e3-4925-a7f4-06f81c377d46/init-textfile/0.log"
Oct 31 01:25:46.546464 ip-10-0-140-47 kubenswrapper[5925]: E1031 01:25:46.546393    5925 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ww2hz" containerName="extractor"